&&&& RUNNING TensorRT.trtexec [TensorRT v8503] # trtexec --onnx=ptq-sparse-640.onnx --saveEngine=ptq-tiny-yolov7-sparse-640.trt --int8 --fp16 --sparsity=enable --useCudaGraph --verbose [04/18/2023-13:39:17] [I] === Model Options === [04/18/2023-13:39:17] [I] Format: ONNX [04/18/2023-13:39:17] [I] Model: ptq-sparse-640.onnx [04/18/2023-13:39:17] [I] Output: [04/18/2023-13:39:17] [I] === Build Options === [04/18/2023-13:39:17] [I] Max batch: explicit batch [04/18/2023-13:39:17] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default [04/18/2023-13:39:17] [I] minTiming: 1 [04/18/2023-13:39:17] [I] avgTiming: 8 [04/18/2023-13:39:17] [I] Precision: FP32+FP16+INT8 [04/18/2023-13:39:17] [I] LayerPrecisions: [04/18/2023-13:39:17] [I] Calibration: Dynamic [04/18/2023-13:39:17] [I] Refit: Disabled [04/18/2023-13:39:17] [I] Sparsity: Enabled [04/18/2023-13:39:17] [I] Safe mode: Disabled [04/18/2023-13:39:17] [I] DirectIO mode: Disabled [04/18/2023-13:39:17] [I] Restricted mode: Disabled [04/18/2023-13:39:17] [I] Build only: Disabled [04/18/2023-13:39:17] [I] Save engine: ptq-tiny-yolov7-sparse-640.trt [04/18/2023-13:39:17] [I] Load engine: [04/18/2023-13:39:17] [I] Profiling verbosity: 0 [04/18/2023-13:39:17] [I] Tactic sources: Using default tactic sources [04/18/2023-13:39:17] [I] timingCacheMode: local [04/18/2023-13:39:17] [I] timingCacheFile: [04/18/2023-13:39:17] [I] Heuristic: Disabled [04/18/2023-13:39:17] [I] Preview Features: Use default preview flags. [04/18/2023-13:39:17] [I] Input(s)s format: fp32:CHW [04/18/2023-13:39:17] [I] Output(s)s format: fp32:CHW [04/18/2023-13:39:17] [I] Input build shapes: model [04/18/2023-13:39:17] [I] Input calibration shapes: model [04/18/2023-13:39:17] [I] === System Options === [04/18/2023-13:39:17] [I] Device: 0 [04/18/2023-13:39:17] [I] DLACore: [04/18/2023-13:39:17] [I] Plugins: [04/18/2023-13:39:17] [I] === Inference Options === [04/18/2023-13:39:17] [I] Batch: Explicit [04/18/2023-13:39:17] [I] Input inference shapes: model [04/18/2023-13:39:17] [I] Iterations: 10 [04/18/2023-13:39:17] [I] Duration: 3s (+ 200ms warm up) [04/18/2023-13:39:17] [I] Sleep time: 0ms [04/18/2023-13:39:17] [I] Idle time: 0ms [04/18/2023-13:39:17] [I] Streams: 1 [04/18/2023-13:39:17] [I] ExposeDMA: Disabled [04/18/2023-13:39:17] [I] Data transfers: Enabled [04/18/2023-13:39:17] [I] Spin-wait: Disabled [04/18/2023-13:39:17] [I] Multithreading: Disabled [04/18/2023-13:39:17] [I] CUDA Graph: Enabled [04/18/2023-13:39:17] [I] Separate profiling: Disabled [04/18/2023-13:39:17] [I] Time Deserialize: Disabled [04/18/2023-13:39:17] [I] Time Refit: Disabled [04/18/2023-13:39:17] [I] NVTX verbosity: 0 [04/18/2023-13:39:17] [I] Persistent Cache Ratio: 0 [04/18/2023-13:39:17] [I] Inputs: [04/18/2023-13:39:17] [I] === Reporting Options === [04/18/2023-13:39:17] [I] Verbose: Enabled [04/18/2023-13:39:17] [I] Averages: 10 inferences [04/18/2023-13:39:17] [I] Percentiles: 90,95,99 [04/18/2023-13:39:17] [I] Dump refittable layers:Disabled [04/18/2023-13:39:17] [I] Dump output: Disabled [04/18/2023-13:39:17] [I] Profile: Disabled [04/18/2023-13:39:17] [I] Export timing to JSON file: [04/18/2023-13:39:17] [I] Export output to JSON file: [04/18/2023-13:39:17] [I] Export profile to JSON file: [04/18/2023-13:39:17] [I] [04/18/2023-13:39:17] [I] === Device Information === [04/18/2023-13:39:17] [I] Selected Device: NVIDIA RTX A5000 [04/18/2023-13:39:17] [I] Compute Capability: 8.6 [04/18/2023-13:39:17] [I] SMs: 64 [04/18/2023-13:39:17] [I] Compute Clock Rate: 1.695 GHz [04/18/2023-13:39:17] [I] Device Global Memory: 24253 MiB [04/18/2023-13:39:17] [I] Shared Memory per SM: 100 KiB [04/18/2023-13:39:17] [I] Memory Bus Width: 384 bits (ECC disabled) [04/18/2023-13:39:17] [I] Memory Clock Rate: 8.001 GHz [04/18/2023-13:39:17] [I] [04/18/2023-13:39:17] [I] TensorRT version: 8.5.3 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::BatchTilePlugin_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::CoordConvAC version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::CropAndResizeDynamic version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::CropAndResize version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::DecodeBbox3DPlugin version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::EfficientNMS_Explicit_TF_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::EfficientNMS_Implicit_TF_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::EfficientNMS_ONNX_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::EfficientNMS_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::fMHA_V2 version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::fMHCA version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::GenerateDetection_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::GridAnchorRect_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::GroupNorm version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 2 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::LayerNorm version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::MultilevelCropAndResize_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::MultilevelProposeROI_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::MultiscaleDeformableAttnPlugin_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::NMSDynamic_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::PillarScatterPlugin version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::ProposalDynamic version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::Proposal version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::Region_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::ROIAlign_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::ScatterND version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::SeqLen2Spatial version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::SplitGeLU version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::Split version 1 [04/18/2023-13:39:17] [V] [TRT] Registered plugin creator - ::VoxelGeneratorPlugin version 1 [04/18/2023-13:39:17] [I] [TRT] [MemUsageChange] Init CUDA: CPU +10, GPU +0, now: CPU 23, GPU 1076 (MiB) [04/18/2023-13:39:17] [V] [TRT] Trying to load shared library libnvinfer_builder_resource.so.8.5.3 [04/18/2023-13:39:17] [V] [TRT] Loaded shared library libnvinfer_builder_resource.so.8.5.3 [04/18/2023-13:39:19] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +444, GPU +120, now: CPU 522, GPU 1196 (MiB) [04/18/2023-13:39:19] [V] [TRT] CUDA lazy loading is enabled. [04/18/2023-13:39:19] [I] Start parsing network model [04/18/2023-13:39:19] [I] [TRT] ---------------------------------------------------------------- [04/18/2023-13:39:19] [I] [TRT] Input filename: ptq-sparse-640.onnx [04/18/2023-13:39:19] [I] [TRT] ONNX IR version: 0.0.7 [04/18/2023-13:39:19] [I] [TRT] Opset version: 13 [04/18/2023-13:39:19] [I] [TRT] Producer name: pytorch [04/18/2023-13:39:19] [I] [TRT] Producer version: 2.0.0 [04/18/2023-13:39:19] [I] [TRT] Domain: [04/18/2023-13:39:19] [I] [TRT] Model version: 0 [04/18/2023-13:39:19] [I] [TRT] Doc string: [04/18/2023-13:39:19] [I] [TRT] ---------------------------------------------------------------- [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::BatchTilePlugin_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::CoordConvAC version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::CropAndResizeDynamic version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::DecodeBbox3DPlugin version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::EfficientNMS_Explicit_TF_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::EfficientNMS_Implicit_TF_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::EfficientNMS_ONNX_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::EfficientNMS_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::fMHA_V2 version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::fMHCA version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::GenerateDetection_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::GridAnchorRect_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::GroupNorm version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 2 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::LayerNorm version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::MultilevelCropAndResize_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::MultilevelProposeROI_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::MultiscaleDeformableAttnPlugin_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::NMSDynamic_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::PillarScatterPlugin version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::ProposalDynamic version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::Proposal version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::ROIAlign_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::ScatterND version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::SeqLen2Spatial version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::SplitGeLU version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::Split version 1 [04/18/2023-13:39:19] [V] [TRT] Plugin creator already registered - ::VoxelGeneratorPlugin version 1 [04/18/2023-13:39:19] [V] [TRT] Adding network input: images with dtype: float32, dimensions: (1, 3, 640, 640) [04/18/2023-13:39:19] [V] [TRT] Registering tensor: images for ONNX tensor: images [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.0.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.0.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.1.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.1.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.2.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.2.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.3.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.3.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.4.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.4.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.5.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.5.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.7.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.7.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.9.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.9.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.10.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.10.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.11.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.11.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.12.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.12.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.14.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.14.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.16.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.16.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.17.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.17.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.18.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.18.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.19.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.19.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.21.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.21.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.23.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.23.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.24.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.24.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.25.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.25.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.26.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.26.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.28.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.28.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.29.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.29.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.30.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.30.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.35.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.35.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.37.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.37.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.38.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.38.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.40.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.40.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.42.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.42.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.43.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.43.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.44.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.44.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.45.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.45.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.47.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.47.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.48.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.48.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.50.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.50.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.52.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.52.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.53.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.53.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.54.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.54.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.55.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.55.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.57.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.57.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.58.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.58.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.60.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.60.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.61.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.61.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.62.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.62.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.63.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.63.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.65.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.65.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.66.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.66.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.68.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.68.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.69.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.69.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.70.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.70.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.71.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.71.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.73.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.73.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.74.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.74.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.75.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.75.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.76.conv.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.76.conv.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.77.m.0.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.77.m.0.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.77.m.1.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.77.m.1.bias [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.77.m.2.weight [04/18/2023-13:39:19] [V] [TRT] Importing initializer: model.77.m.2.bias [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.0/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.0/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.0/conv/_input_quantizer/Constant [Constant] outputs: [/model.0/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.0/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.0/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.0/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.0/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.0/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: images [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.0/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.0/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.0/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [images -> (1, 3, 640, 640)[FLOAT]], [/model.0/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.0/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.0/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.0/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.0/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.0/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.0/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.0/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.0/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.0/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 3, 640, 640)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.0/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.0/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.0/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.0/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.0/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.0/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 3, 640, 640)[FLOAT]], [/model.0/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.0/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.0/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.0/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.0/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.0/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 3, 640, 640)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.0/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.0/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.0/conv/_weight_quantizer/Constant [Constant] outputs: [/model.0/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.0/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.0/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.0/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.0/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.0/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.0.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.0/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.0/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.0/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.0.conv.weight -> (32, 3, 3, 3)[FLOAT]], [/model.0/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.0/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.0.conv.weight for ONNX node: model.0.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.0/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.0/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.0/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.0/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.0/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.0/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.0/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.0/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 3, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.0/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.0/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.0/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.0/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.0/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.0/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 3, 3, 3)[FLOAT]], [/model.0/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.0/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.0/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.0/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.0/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.0/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 3, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.0/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.0/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.0/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.0.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.0/conv/Conv [Conv] inputs: [/model.0/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 3, 640, 640)[FLOAT]], [/model.0/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 3, 3, 3)[FLOAT]], [model.0.conv.bias -> (32)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.0/conv/Conv for ONNX node: /model.0/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.0/conv/Conv_output_0 for ONNX tensor: /model.0/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.0/conv/Conv [Conv] outputs: [/model.0/conv/Conv_output_0 -> (1, 32, 320, 320)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.0/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.0/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.0/act/LeakyRelu [LeakyRelu] inputs: [/model.0/conv/Conv_output_0 -> (1, 32, 320, 320)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.0/act/LeakyRelu for ONNX node: /model.0/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.0/act/LeakyRelu_output_0 for ONNX tensor: /model.0/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.0/act/LeakyRelu [LeakyRelu] outputs: [/model.0/act/LeakyRelu_output_0 -> (1, 32, 320, 320)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.1/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.1/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.1/conv/_input_quantizer/Constant [Constant] outputs: [/model.1/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.1/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.1/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.1/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.1/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.1/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.0/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.1/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.1/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.1/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.0/act/LeakyRelu_output_0 -> (1, 32, 320, 320)[FLOAT]], [/model.1/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.1/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.1/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.1/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.1/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.1/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.1/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.1/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.1/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.1/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 32, 320, 320)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.1/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.1/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.1/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.1/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.1/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.1/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 32, 320, 320)[FLOAT]], [/model.1/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.1/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.1/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.1/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.1/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.1/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 32, 320, 320)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.1/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.1/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.1/conv/_weight_quantizer/Constant [Constant] outputs: [/model.1/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.1/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.1/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.1/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.1/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.1/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.1.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.1/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.1/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.1/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.1.conv.weight -> (64, 32, 3, 3)[FLOAT]], [/model.1/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.1/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.1.conv.weight for ONNX node: model.1.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.1/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.1/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.1/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.1/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.1/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.1/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.1/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.1/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 32, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.1/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.1/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.1/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.1/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.1/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.1/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 32, 3, 3)[FLOAT]], [/model.1/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.1/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.1/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.1/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.1/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.1/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 32, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.1/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.1/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.1/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.1.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.1/conv/Conv [Conv] inputs: [/model.1/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 32, 320, 320)[FLOAT]], [/model.1/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 32, 3, 3)[FLOAT]], [model.1.conv.bias -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.1/conv/Conv for ONNX node: /model.1/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.1/conv/Conv_output_0 for ONNX tensor: /model.1/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.1/conv/Conv [Conv] outputs: [/model.1/conv/Conv_output_0 -> (1, 64, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.1/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.1/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.1/act/LeakyRelu [LeakyRelu] inputs: [/model.1/conv/Conv_output_0 -> (1, 64, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.1/act/LeakyRelu for ONNX node: /model.1/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.1/act/LeakyRelu_output_0 for ONNX tensor: /model.1/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.1/act/LeakyRelu [LeakyRelu] outputs: [/model.1/act/LeakyRelu_output_0 -> (1, 64, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.2/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.2/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.2/conv/_input_quantizer/Constant [Constant] outputs: [/model.2/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.2/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.2/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.2/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.2/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.2/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.1/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.2/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.2/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.2/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.1/act/LeakyRelu_output_0 -> (1, 64, 160, 160)[FLOAT]], [/model.2/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.2/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.2/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.2/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.2/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.2/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.2/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.2/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.2/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.2/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.2/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.2/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.2/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.2/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.2/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.2/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 160, 160)[FLOAT]], [/model.2/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.2/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.2/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.2/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.2/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.2/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.2/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.2/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.2/conv/_weight_quantizer/Constant [Constant] outputs: [/model.2/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.2/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.2/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.2/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.2/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.2/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.2.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.2/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.2/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.2/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.2.conv.weight -> (32, 64, 1, 1)[FLOAT]], [/model.2/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.2/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.2.conv.weight for ONNX node: model.2.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.2/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.2/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.2/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.2/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.2/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.2/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.2/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.2/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 64, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.2/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.2/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.2/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.2/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.2/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.2/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 64, 1, 1)[FLOAT]], [/model.2/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.2/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.2/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.2/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.2/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.2/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 64, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.2/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.2/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.2/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.2.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.2/conv/Conv [Conv] inputs: [/model.2/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 160, 160)[FLOAT]], [/model.2/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 64, 1, 1)[FLOAT]], [model.2.conv.bias -> (32)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.2/conv/Conv for ONNX node: /model.2/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.2/conv/Conv_output_0 for ONNX tensor: /model.2/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.2/conv/Conv [Conv] outputs: [/model.2/conv/Conv_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.2/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.2/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.2/act/LeakyRelu [LeakyRelu] inputs: [/model.2/conv/Conv_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.2/act/LeakyRelu for ONNX node: /model.2/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.2/act/LeakyRelu_output_0 for ONNX tensor: /model.2/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.2/act/LeakyRelu [LeakyRelu] outputs: [/model.2/act/LeakyRelu_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.3/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.3/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.3/conv/_input_quantizer/Constant [Constant] outputs: [/model.3/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.3/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.3/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.3/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.3/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.3/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.1/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.3/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.3/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.3/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.1/act/LeakyRelu_output_0 -> (1, 64, 160, 160)[FLOAT]], [/model.3/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.3/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.3/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.3/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.3/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.3/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.3/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.3/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.3/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.3/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.3/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.3/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.3/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.3/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.3/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.3/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 160, 160)[FLOAT]], [/model.3/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.3/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.3/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.3/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.3/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.3/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.3/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.3/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.3/conv/_weight_quantizer/Constant [Constant] outputs: [/model.3/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.3/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.3/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.3/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.3/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.3/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.3.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.3/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.3/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.3/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.3.conv.weight -> (32, 64, 1, 1)[FLOAT]], [/model.3/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.3/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.3.conv.weight for ONNX node: model.3.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.3/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.3/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.3/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.3/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.3/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.3/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.3/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.3/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 64, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.3/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.3/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.3/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.3/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.3/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.3/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 64, 1, 1)[FLOAT]], [/model.3/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.3/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.3/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.3/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.3/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.3/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 64, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.3/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.3/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.3/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.3.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.3/conv/Conv [Conv] inputs: [/model.3/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 160, 160)[FLOAT]], [/model.3/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 64, 1, 1)[FLOAT]], [model.3.conv.bias -> (32)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.3/conv/Conv for ONNX node: /model.3/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.3/conv/Conv_output_0 for ONNX tensor: /model.3/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.3/conv/Conv [Conv] outputs: [/model.3/conv/Conv_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.3/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.3/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.3/act/LeakyRelu [LeakyRelu] inputs: [/model.3/conv/Conv_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.3/act/LeakyRelu for ONNX node: /model.3/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.3/act/LeakyRelu_output_0 for ONNX tensor: /model.3/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.3/act/LeakyRelu [LeakyRelu] outputs: [/model.3/act/LeakyRelu_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.4/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.4/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.4/conv/_input_quantizer/Constant [Constant] outputs: [/model.4/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.4/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.4/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.4/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.4/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.4/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.3/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.4/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.4/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.4/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.3/act/LeakyRelu_output_0 -> (1, 32, 160, 160)[FLOAT]], [/model.4/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.4/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.4/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.4/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.4/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.4/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.4/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.4/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.4/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.4/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.4/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.4/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.4/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.4/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.4/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.4/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 32, 160, 160)[FLOAT]], [/model.4/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.4/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.4/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.4/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.4/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.4/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.4/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.4/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.4/conv/_weight_quantizer/Constant [Constant] outputs: [/model.4/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.4/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.4/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.4/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.4/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.4/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.4.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.4/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.4/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.4/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.4.conv.weight -> (32, 32, 3, 3)[FLOAT]], [/model.4/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.4/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.4.conv.weight for ONNX node: model.4.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.4/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.4/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.4/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.4/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.4/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.4/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.4/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.4/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.4/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.4/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.4/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.4/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.4/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.4/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [/model.4/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.4/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.4/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.4/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.4/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.4/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.4/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.4/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.4/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.4.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.4/conv/Conv [Conv] inputs: [/model.4/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 32, 160, 160)[FLOAT]], [/model.4/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [model.4.conv.bias -> (32)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.4/conv/Conv for ONNX node: /model.4/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.4/conv/Conv_output_0 for ONNX tensor: /model.4/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.4/conv/Conv [Conv] outputs: [/model.4/conv/Conv_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.4/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.4/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.4/act/LeakyRelu [LeakyRelu] inputs: [/model.4/conv/Conv_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.4/act/LeakyRelu for ONNX node: /model.4/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.4/act/LeakyRelu_output_0 for ONNX tensor: /model.4/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.4/act/LeakyRelu [LeakyRelu] outputs: [/model.4/act/LeakyRelu_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.5/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.5/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.5/conv/_input_quantizer/Constant [Constant] outputs: [/model.5/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.5/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.5/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.5/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.5/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.5/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.4/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.5/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.5/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.5/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.4/act/LeakyRelu_output_0 -> (1, 32, 160, 160)[FLOAT]], [/model.5/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.5/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.5/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.5/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.5/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.5/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.5/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.5/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.5/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.5/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.5/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.5/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.5/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.5/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.5/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.5/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 32, 160, 160)[FLOAT]], [/model.5/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.5/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.5/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.5/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.5/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.5/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.5/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.5/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.5/conv/_weight_quantizer/Constant [Constant] outputs: [/model.5/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.5/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.5/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.5/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.5/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.5/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.5.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.5/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.5/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.5/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.5.conv.weight -> (32, 32, 3, 3)[FLOAT]], [/model.5/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.5/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.5.conv.weight for ONNX node: model.5.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.5/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.5/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.5/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.5/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.5/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.5/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.5/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.5/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.5/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.5/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.5/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.5/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.5/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.5/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [/model.5/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.5/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.5/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.5/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.5/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.5/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.5/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.5/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.5/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.5.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.5/conv/Conv [Conv] inputs: [/model.5/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 32, 160, 160)[FLOAT]], [/model.5/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [model.5.conv.bias -> (32)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.5/conv/Conv for ONNX node: /model.5/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.5/conv/Conv_output_0 for ONNX tensor: /model.5/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.5/conv/Conv [Conv] outputs: [/model.5/conv/Conv_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.5/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.5/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.5/act/LeakyRelu [LeakyRelu] inputs: [/model.5/conv/Conv_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.5/act/LeakyRelu for ONNX node: /model.5/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.5/act/LeakyRelu_output_0 for ONNX tensor: /model.5/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.5/act/LeakyRelu [LeakyRelu] outputs: [/model.5/act/LeakyRelu_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.6/Concat [Concat] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.5/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.4/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.3/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.2/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.6/Concat [Concat] inputs: [/model.5/act/LeakyRelu_output_0 -> (1, 32, 160, 160)[FLOAT]], [/model.4/act/LeakyRelu_output_0 -> (1, 32, 160, 160)[FLOAT]], [/model.3/act/LeakyRelu_output_0 -> (1, 32, 160, 160)[FLOAT]], [/model.2/act/LeakyRelu_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.6/Concat for ONNX node: /model.6/Concat [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.6/Concat_output_0 for ONNX tensor: /model.6/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.6/Concat [Concat] outputs: [/model.6/Concat_output_0 -> (1, 128, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.7/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.7/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.7/conv/_input_quantizer/Constant [Constant] outputs: [/model.7/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.7/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.7/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.7/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.7/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.7/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.6/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.7/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.7/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.7/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.6/Concat_output_0 -> (1, 128, 160, 160)[FLOAT]], [/model.7/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.7/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.7/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.7/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.7/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.7/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.7/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.7/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.7/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.7/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.7/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.7/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.7/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.7/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.7/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.7/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 160, 160)[FLOAT]], [/model.7/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.7/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.7/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.7/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.7/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.7/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.7/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.7/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.7/conv/_weight_quantizer/Constant [Constant] outputs: [/model.7/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.7/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.7/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.7/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.7/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.7/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.7.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.7/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.7/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.7/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.7.conv.weight -> (64, 128, 1, 1)[FLOAT]], [/model.7/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.7/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.7.conv.weight for ONNX node: model.7.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.7/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.7/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.7/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.7/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.7/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.7/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.7/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.7/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.7/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.7/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.7/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.7/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.7/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.7/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [/model.7/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.7/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.7/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.7/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.7/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.7/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.7/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.7/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.7/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.7.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.7/conv/Conv [Conv] inputs: [/model.7/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 160, 160)[FLOAT]], [/model.7/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [model.7.conv.bias -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.7/conv/Conv for ONNX node: /model.7/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.7/conv/Conv_output_0 for ONNX tensor: /model.7/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.7/conv/Conv [Conv] outputs: [/model.7/conv/Conv_output_0 -> (1, 64, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.7/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.7/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.7/act/LeakyRelu [LeakyRelu] inputs: [/model.7/conv/Conv_output_0 -> (1, 64, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.7/act/LeakyRelu for ONNX node: /model.7/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.7/act/LeakyRelu_output_0 for ONNX tensor: /model.7/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.7/act/LeakyRelu [LeakyRelu] outputs: [/model.7/act/LeakyRelu_output_0 -> (1, 64, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.8/m/MaxPool [MaxPool] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.7/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.8/m/MaxPool [MaxPool] inputs: [/model.7/act/LeakyRelu_output_0 -> (1, 64, 160, 160)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.8/m/MaxPool for ONNX node: /model.8/m/MaxPool [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.8/m/MaxPool_output_0 for ONNX tensor: /model.8/m/MaxPool_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.8/m/MaxPool [MaxPool] outputs: [/model.8/m/MaxPool_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.9/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.9/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.9/conv/_input_quantizer/Constant [Constant] outputs: [/model.9/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.9/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.9/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.9/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.9/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.9/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.8/m/MaxPool_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.9/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.9/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.9/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.8/m/MaxPool_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.9/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.9/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.9/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.9/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.9/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.9/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.9/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.9/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.9/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.9/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.9/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.9/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.9/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.9/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.9/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.9/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.9/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.9/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.9/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.9/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.9/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.9/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.9/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.9/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.9/conv/_weight_quantizer/Constant [Constant] outputs: [/model.9/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.9/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.9/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.9/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.9/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.9/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.9.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.9/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.9/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.9/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.9.conv.weight -> (64, 64, 1, 1)[FLOAT]], [/model.9/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.9/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.9.conv.weight for ONNX node: model.9.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.9/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.9/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.9/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.9/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.9/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.9/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.9/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.9/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.9/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.9/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.9/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.9/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.9/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.9/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 1, 1)[FLOAT]], [/model.9/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.9/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.9/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.9/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.9/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.9/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.9/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.9/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.9/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.9.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.9/conv/Conv [Conv] inputs: [/model.9/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.9/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 1, 1)[FLOAT]], [model.9.conv.bias -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.9/conv/Conv for ONNX node: /model.9/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.9/conv/Conv_output_0 for ONNX tensor: /model.9/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.9/conv/Conv [Conv] outputs: [/model.9/conv/Conv_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.9/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.9/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.9/act/LeakyRelu [LeakyRelu] inputs: [/model.9/conv/Conv_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.9/act/LeakyRelu for ONNX node: /model.9/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.9/act/LeakyRelu_output_0 for ONNX tensor: /model.9/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.9/act/LeakyRelu [LeakyRelu] outputs: [/model.9/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.10/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.10/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.10/conv/_weight_quantizer/Constant [Constant] outputs: [/model.10/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.10/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.10/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.10/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.10/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.10/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.10.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.10/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.10/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.10/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.10.conv.weight -> (64, 64, 1, 1)[FLOAT]], [/model.10/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.10/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.10.conv.weight for ONNX node: model.10.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.10/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.10/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.10/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.10/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.10/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.10/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.10/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.10/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.10/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.10/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.10/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.10/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.10/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.10/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 1, 1)[FLOAT]], [/model.10/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.10/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.10/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.10/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.10/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.10/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.10/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.9/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.10/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.10.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.10/conv/Conv [Conv] inputs: [/model.9/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.10/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 1, 1)[FLOAT]], [model.10.conv.bias -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.10/conv/Conv for ONNX node: /model.10/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.10/conv/Conv_output_0 for ONNX tensor: /model.10/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.10/conv/Conv [Conv] outputs: [/model.10/conv/Conv_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.10/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.10/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.10/act/LeakyRelu [LeakyRelu] inputs: [/model.10/conv/Conv_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.10/act/LeakyRelu for ONNX node: /model.10/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.10/act/LeakyRelu_output_0 for ONNX tensor: /model.10/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.10/act/LeakyRelu [LeakyRelu] outputs: [/model.10/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.11/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.11/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.11/conv/_input_quantizer/Constant [Constant] outputs: [/model.11/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.11/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.11/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.11/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.11/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.11/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.10/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.11/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.11/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.11/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.10/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.11/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.11/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.11/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.11/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.11/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.11/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.11/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.11/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.11/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.11/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.11/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.11/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.11/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.11/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.11/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.11/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.11/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.11/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.11/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.11/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.11/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.11/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.11/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.11/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.11/conv/_weight_quantizer/Constant [Constant] outputs: [/model.11/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.11/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.11/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.11/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.11/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.11/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.11.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.11/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.11/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.11/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.11.conv.weight -> (64, 64, 3, 3)[FLOAT]], [/model.11/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.11/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.11.conv.weight for ONNX node: model.11.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.11/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.11/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.11/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.11/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.11/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.11/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.11/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.11/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.11/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.11/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.11/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.11/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.11/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.11/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [/model.11/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.11/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.11/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.11/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.11/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.11/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.11/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.11/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.11/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.11.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.11/conv/Conv [Conv] inputs: [/model.11/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.11/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [model.11.conv.bias -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.11/conv/Conv for ONNX node: /model.11/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.11/conv/Conv_output_0 for ONNX tensor: /model.11/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.11/conv/Conv [Conv] outputs: [/model.11/conv/Conv_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.11/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.11/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.11/act/LeakyRelu [LeakyRelu] inputs: [/model.11/conv/Conv_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.11/act/LeakyRelu for ONNX node: /model.11/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.11/act/LeakyRelu_output_0 for ONNX tensor: /model.11/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.11/act/LeakyRelu [LeakyRelu] outputs: [/model.11/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.12/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.12/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.12/conv/_input_quantizer/Constant [Constant] outputs: [/model.12/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.12/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.12/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.12/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.12/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.12/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.11/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.12/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.12/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.12/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.11/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.12/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.12/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.12/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.12/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.12/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.12/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.12/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.12/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.12/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.12/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.12/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.12/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.12/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.12/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.12/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.12/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.12/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.12/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.12/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.12/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.12/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.12/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.12/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.12/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.12/conv/_weight_quantizer/Constant [Constant] outputs: [/model.12/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.12/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.12/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.12/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.12/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.12/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.12.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.12/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.12/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.12/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.12.conv.weight -> (64, 64, 3, 3)[FLOAT]], [/model.12/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.12/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.12.conv.weight for ONNX node: model.12.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.12/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.12/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.12/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.12/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.12/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.12/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.12/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.12/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.12/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.12/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.12/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.12/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.12/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.12/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [/model.12/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.12/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.12/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.12/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.12/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.12/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.12/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.12/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.12/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.12.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.12/conv/Conv [Conv] inputs: [/model.12/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.12/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [model.12.conv.bias -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.12/conv/Conv for ONNX node: /model.12/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.12/conv/Conv_output_0 for ONNX tensor: /model.12/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.12/conv/Conv [Conv] outputs: [/model.12/conv/Conv_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.12/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.12/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.12/act/LeakyRelu [LeakyRelu] inputs: [/model.12/conv/Conv_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.12/act/LeakyRelu for ONNX node: /model.12/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.12/act/LeakyRelu_output_0 for ONNX tensor: /model.12/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.12/act/LeakyRelu [LeakyRelu] outputs: [/model.12/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.13/Concat [Concat] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.12/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.11/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.10/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.9/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.13/Concat [Concat] inputs: [/model.12/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.11/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.10/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.9/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.13/Concat for ONNX node: /model.13/Concat [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.13/Concat_output_0 for ONNX tensor: /model.13/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.13/Concat [Concat] outputs: [/model.13/Concat_output_0 -> (1, 256, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.14/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.14/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.14/conv/_input_quantizer/Constant [Constant] outputs: [/model.14/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.14/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.14/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.14/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.14/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.14/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.13/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.14/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.14/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.14/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.13/Concat_output_0 -> (1, 256, 80, 80)[FLOAT]], [/model.14/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.14/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.14/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.14/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.14/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.14/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.14/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.14/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.14/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.14/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.14/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.14/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.14/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.14/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.14/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.14/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 80, 80)[FLOAT]], [/model.14/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.14/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.14/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.14/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.14/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.14/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.14/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.14/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.14/conv/_weight_quantizer/Constant [Constant] outputs: [/model.14/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.14/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.14/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.14/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.14/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.14/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.14.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.14/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.14/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.14/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.14.conv.weight -> (128, 256, 1, 1)[FLOAT]], [/model.14/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.14/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.14.conv.weight for ONNX node: model.14.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.14/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.14/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.14/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.14/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.14/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.14/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.14/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.14/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.14/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.14/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.14/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.14/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.14/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.14/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [/model.14/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.14/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.14/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.14/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.14/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.14/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.14/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.14/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.14/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.14.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.14/conv/Conv [Conv] inputs: [/model.14/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 80, 80)[FLOAT]], [/model.14/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [model.14.conv.bias -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.14/conv/Conv for ONNX node: /model.14/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.14/conv/Conv_output_0 for ONNX tensor: /model.14/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.14/conv/Conv [Conv] outputs: [/model.14/conv/Conv_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.14/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.14/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.14/act/LeakyRelu [LeakyRelu] inputs: [/model.14/conv/Conv_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.14/act/LeakyRelu for ONNX node: /model.14/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.14/act/LeakyRelu_output_0 for ONNX tensor: /model.14/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.14/act/LeakyRelu [LeakyRelu] outputs: [/model.14/act/LeakyRelu_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.15/m/MaxPool [MaxPool] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.14/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.15/m/MaxPool [MaxPool] inputs: [/model.14/act/LeakyRelu_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.15/m/MaxPool for ONNX node: /model.15/m/MaxPool [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.15/m/MaxPool_output_0 for ONNX tensor: /model.15/m/MaxPool_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.15/m/MaxPool [MaxPool] outputs: [/model.15/m/MaxPool_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.16/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.16/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.16/conv/_input_quantizer/Constant [Constant] outputs: [/model.16/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.16/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.16/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.16/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.16/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.16/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.15/m/MaxPool_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.16/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.16/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.16/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.15/m/MaxPool_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.16/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.16/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.16/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.16/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.16/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.16/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.16/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.16/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.16/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.16/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.16/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.16/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.16/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.16/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.16/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.16/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.16/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.16/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.16/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.16/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.16/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.16/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.16/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.16/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.16/conv/_weight_quantizer/Constant [Constant] outputs: [/model.16/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.16/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.16/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.16/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.16/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.16/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.16.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.16/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.16/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.16/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.16.conv.weight -> (128, 128, 1, 1)[FLOAT]], [/model.16/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.16/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.16.conv.weight for ONNX node: model.16.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.16/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.16/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.16/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.16/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.16/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.16/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.16/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.16/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 128, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.16/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.16/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.16/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.16/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.16/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.16/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 128, 1, 1)[FLOAT]], [/model.16/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.16/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.16/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.16/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.16/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.16/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 128, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.16/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.16/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.16/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.16.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.16/conv/Conv [Conv] inputs: [/model.16/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.16/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 128, 1, 1)[FLOAT]], [model.16.conv.bias -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.16/conv/Conv for ONNX node: /model.16/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.16/conv/Conv_output_0 for ONNX tensor: /model.16/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.16/conv/Conv [Conv] outputs: [/model.16/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.16/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.16/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.16/act/LeakyRelu [LeakyRelu] inputs: [/model.16/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.16/act/LeakyRelu for ONNX node: /model.16/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.16/act/LeakyRelu_output_0 for ONNX tensor: /model.16/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.16/act/LeakyRelu [LeakyRelu] outputs: [/model.16/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.17/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.17/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.17/conv/_input_quantizer/Constant [Constant] outputs: [/model.17/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.17/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.17/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.17/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.17/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.17/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.15/m/MaxPool_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.17/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.17/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.17/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.15/m/MaxPool_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.17/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.17/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.17/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.17/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.17/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.17/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.17/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.17/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.17/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.17/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.17/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.17/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.17/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.17/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.17/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.17/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.17/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.17/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.17/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.17/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.17/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.17/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.17/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.17/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.17/conv/_weight_quantizer/Constant [Constant] outputs: [/model.17/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.17/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.17/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.17/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.17/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.17/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.17.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.17/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.17/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.17/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.17.conv.weight -> (128, 128, 1, 1)[FLOAT]], [/model.17/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.17/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.17.conv.weight for ONNX node: model.17.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.17/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.17/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.17/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.17/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.17/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.17/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.17/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.17/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 128, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.17/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.17/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.17/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.17/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.17/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.17/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 128, 1, 1)[FLOAT]], [/model.17/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.17/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.17/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.17/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.17/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.17/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 128, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.17/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.17/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.17/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.17.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.17/conv/Conv [Conv] inputs: [/model.17/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.17/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 128, 1, 1)[FLOAT]], [model.17.conv.bias -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.17/conv/Conv for ONNX node: /model.17/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.17/conv/Conv_output_0 for ONNX tensor: /model.17/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.17/conv/Conv [Conv] outputs: [/model.17/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.17/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.17/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.17/act/LeakyRelu [LeakyRelu] inputs: [/model.17/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.17/act/LeakyRelu for ONNX node: /model.17/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.17/act/LeakyRelu_output_0 for ONNX tensor: /model.17/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.17/act/LeakyRelu [LeakyRelu] outputs: [/model.17/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.18/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.18/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.18/conv/_input_quantizer/Constant [Constant] outputs: [/model.18/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.18/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.18/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.18/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.18/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.18/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.17/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.18/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.18/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.18/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.17/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.18/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.18/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.18/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.18/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.18/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.18/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.18/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.18/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.18/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.18/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.18/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.18/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.18/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.18/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.18/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.18/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.18/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.18/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.18/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.18/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.18/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.18/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.18/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.18/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.18/conv/_weight_quantizer/Constant [Constant] outputs: [/model.18/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.18/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.18/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.18/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.18/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.18/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.18.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.18/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.18/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.18/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.18.conv.weight -> (128, 128, 3, 3)[FLOAT]], [/model.18/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.18/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.18.conv.weight for ONNX node: model.18.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.18/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.18/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.18/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.18/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.18/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.18/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.18/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.18/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.18/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.18/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.18/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.18/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.18/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.18/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [/model.18/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.18/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.18/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.18/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.18/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.18/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.18/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.18/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.18/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.18.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.18/conv/Conv [Conv] inputs: [/model.18/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.18/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [model.18.conv.bias -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.18/conv/Conv for ONNX node: /model.18/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.18/conv/Conv_output_0 for ONNX tensor: /model.18/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.18/conv/Conv [Conv] outputs: [/model.18/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.18/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.18/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.18/act/LeakyRelu [LeakyRelu] inputs: [/model.18/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.18/act/LeakyRelu for ONNX node: /model.18/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.18/act/LeakyRelu_output_0 for ONNX tensor: /model.18/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.18/act/LeakyRelu [LeakyRelu] outputs: [/model.18/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.19/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.19/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.19/conv/_input_quantizer/Constant [Constant] outputs: [/model.19/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.19/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.19/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.19/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.19/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.19/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.18/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.19/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.19/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.19/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.18/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.19/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.19/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.19/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.19/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.19/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.19/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.19/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.19/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.19/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.19/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.19/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.19/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.19/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.19/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.19/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.19/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.19/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.19/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.19/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.19/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.19/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.19/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.19/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.19/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.19/conv/_weight_quantizer/Constant [Constant] outputs: [/model.19/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.19/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.19/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.19/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.19/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.19/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.19.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.19/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.19/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.19/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.19.conv.weight -> (128, 128, 3, 3)[FLOAT]], [/model.19/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.19/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.19.conv.weight for ONNX node: model.19.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.19/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.19/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.19/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.19/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.19/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.19/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.19/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.19/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.19/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.19/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.19/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.19/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.19/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.19/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [/model.19/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.19/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.19/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.19/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.19/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.19/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.19/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.19/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.19/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.19.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.19/conv/Conv [Conv] inputs: [/model.19/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.19/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [model.19.conv.bias -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.19/conv/Conv for ONNX node: /model.19/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.19/conv/Conv_output_0 for ONNX tensor: /model.19/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.19/conv/Conv [Conv] outputs: [/model.19/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.19/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.19/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.19/act/LeakyRelu [LeakyRelu] inputs: [/model.19/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.19/act/LeakyRelu for ONNX node: /model.19/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.19/act/LeakyRelu_output_0 for ONNX tensor: /model.19/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.19/act/LeakyRelu [LeakyRelu] outputs: [/model.19/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.20/Concat [Concat] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.19/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.18/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.17/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.16/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.20/Concat [Concat] inputs: [/model.19/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.18/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.17/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.16/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.20/Concat for ONNX node: /model.20/Concat [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.20/Concat_output_0 for ONNX tensor: /model.20/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.20/Concat [Concat] outputs: [/model.20/Concat_output_0 -> (1, 512, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.21/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.21/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.21/conv/_input_quantizer/Constant [Constant] outputs: [/model.21/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.21/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.21/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.21/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.21/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.21/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.20/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.21/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.21/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.21/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.20/Concat_output_0 -> (1, 512, 40, 40)[FLOAT]], [/model.21/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.21/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.21/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.21/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.21/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.21/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.21/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.21/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.21/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.21/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.21/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.21/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.21/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.21/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.21/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.21/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 40, 40)[FLOAT]], [/model.21/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.21/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.21/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.21/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.21/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.21/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.21/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.21/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.21/conv/_weight_quantizer/Constant [Constant] outputs: [/model.21/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.21/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.21/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.21/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.21/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.21/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.21.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.21/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.21/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.21/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.21.conv.weight -> (256, 512, 1, 1)[FLOAT]], [/model.21/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.21/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.21.conv.weight for ONNX node: model.21.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.21/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.21/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.21/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.21/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.21/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.21/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.21/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.21/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.21/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.21/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.21/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.21/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.21/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.21/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [/model.21/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.21/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.21/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.21/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.21/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.21/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.21/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.21/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.21/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.21.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.21/conv/Conv [Conv] inputs: [/model.21/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 40, 40)[FLOAT]], [/model.21/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [model.21.conv.bias -> (256)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.21/conv/Conv for ONNX node: /model.21/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.21/conv/Conv_output_0 for ONNX tensor: /model.21/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.21/conv/Conv [Conv] outputs: [/model.21/conv/Conv_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.21/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.21/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.21/act/LeakyRelu [LeakyRelu] inputs: [/model.21/conv/Conv_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.21/act/LeakyRelu for ONNX node: /model.21/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.21/act/LeakyRelu_output_0 for ONNX tensor: /model.21/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.21/act/LeakyRelu [LeakyRelu] outputs: [/model.21/act/LeakyRelu_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.22/m/MaxPool [MaxPool] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.21/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.22/m/MaxPool [MaxPool] inputs: [/model.21/act/LeakyRelu_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.22/m/MaxPool for ONNX node: /model.22/m/MaxPool [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.22/m/MaxPool_output_0 for ONNX tensor: /model.22/m/MaxPool_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.22/m/MaxPool [MaxPool] outputs: [/model.22/m/MaxPool_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.23/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.23/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.23/conv/_input_quantizer/Constant [Constant] outputs: [/model.23/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.23/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.23/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.23/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.23/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.23/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.22/m/MaxPool_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.23/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.23/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.23/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.22/m/MaxPool_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.23/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.23/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.23/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.23/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.23/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.23/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.23/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.23/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.23/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.23/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.23/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.23/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.23/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.23/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.23/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.23/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.23/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.23/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.23/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.23/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.23/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.23/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.23/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.23/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.23/conv/_weight_quantizer/Constant [Constant] outputs: [/model.23/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.23/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.23/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.23/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.23/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.23/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.23.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.23/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.23/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.23/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.23.conv.weight -> (256, 256, 1, 1)[FLOAT]], [/model.23/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.23/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.23.conv.weight for ONNX node: model.23.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.23/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.23/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.23/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.23/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.23/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.23/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.23/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.23/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 256, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.23/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.23/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.23/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.23/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.23/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.23/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 256, 1, 1)[FLOAT]], [/model.23/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.23/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.23/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.23/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.23/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.23/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 256, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.23/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.23/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.23/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.23.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.23/conv/Conv [Conv] inputs: [/model.23/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.23/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 256, 1, 1)[FLOAT]], [model.23.conv.bias -> (256)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.23/conv/Conv for ONNX node: /model.23/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.23/conv/Conv_output_0 for ONNX tensor: /model.23/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.23/conv/Conv [Conv] outputs: [/model.23/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.23/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.23/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.23/act/LeakyRelu [LeakyRelu] inputs: [/model.23/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.23/act/LeakyRelu for ONNX node: /model.23/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.23/act/LeakyRelu_output_0 for ONNX tensor: /model.23/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.23/act/LeakyRelu [LeakyRelu] outputs: [/model.23/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.24/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.24/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.24/conv/_input_quantizer/Constant [Constant] outputs: [/model.24/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.24/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.24/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.24/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.24/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.24/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.22/m/MaxPool_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.24/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.24/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.24/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.22/m/MaxPool_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.24/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.24/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.24/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.24/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.24/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.24/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.24/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.24/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.24/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.24/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.24/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.24/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.24/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.24/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.24/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.24/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.24/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.24/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.24/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.24/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.24/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.24/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.24/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.24/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.24/conv/_weight_quantizer/Constant [Constant] outputs: [/model.24/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.24/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.24/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.24/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.24/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.24/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.24.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.24/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.24/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.24/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.24.conv.weight -> (256, 256, 1, 1)[FLOAT]], [/model.24/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.24/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.24.conv.weight for ONNX node: model.24.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.24/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.24/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.24/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.24/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.24/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.24/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.24/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.24/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 256, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.24/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.24/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.24/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.24/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.24/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.24/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 256, 1, 1)[FLOAT]], [/model.24/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.24/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.24/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.24/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.24/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.24/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 256, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.24/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.24/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.24/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.24.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.24/conv/Conv [Conv] inputs: [/model.24/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.24/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 256, 1, 1)[FLOAT]], [model.24.conv.bias -> (256)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.24/conv/Conv for ONNX node: /model.24/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.24/conv/Conv_output_0 for ONNX tensor: /model.24/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.24/conv/Conv [Conv] outputs: [/model.24/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.24/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.24/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.24/act/LeakyRelu [LeakyRelu] inputs: [/model.24/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.24/act/LeakyRelu for ONNX node: /model.24/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.24/act/LeakyRelu_output_0 for ONNX tensor: /model.24/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.24/act/LeakyRelu [LeakyRelu] outputs: [/model.24/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.25/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.25/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.25/conv/_input_quantizer/Constant [Constant] outputs: [/model.25/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.25/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.25/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.25/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.25/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.25/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.24/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.25/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.25/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.25/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.24/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.25/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.25/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.25/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.25/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.25/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.25/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.25/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.25/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.25/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.25/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.25/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.25/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.25/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.25/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.25/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.25/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.25/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.25/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.25/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.25/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.25/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.25/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.25/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.25/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.25/conv/_weight_quantizer/Constant [Constant] outputs: [/model.25/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.25/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.25/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.25/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.25/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.25/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.25.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.25/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.25/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.25/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.25.conv.weight -> (256, 256, 3, 3)[FLOAT]], [/model.25/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.25/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.25.conv.weight for ONNX node: model.25.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.25/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.25/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.25/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.25/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.25/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.25/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.25/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.25/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 256, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.25/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.25/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.25/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.25/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.25/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.25/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 256, 3, 3)[FLOAT]], [/model.25/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.25/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.25/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.25/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.25/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.25/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 256, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.25/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.25/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.25/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.25.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.25/conv/Conv [Conv] inputs: [/model.25/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.25/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 256, 3, 3)[FLOAT]], [model.25.conv.bias -> (256)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.25/conv/Conv for ONNX node: /model.25/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.25/conv/Conv_output_0 for ONNX tensor: /model.25/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.25/conv/Conv [Conv] outputs: [/model.25/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.25/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.25/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.25/act/LeakyRelu [LeakyRelu] inputs: [/model.25/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.25/act/LeakyRelu for ONNX node: /model.25/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.25/act/LeakyRelu_output_0 for ONNX tensor: /model.25/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.25/act/LeakyRelu [LeakyRelu] outputs: [/model.25/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.26/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.26/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.26/conv/_input_quantizer/Constant [Constant] outputs: [/model.26/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.26/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.26/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.26/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.26/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.26/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.25/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.26/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.26/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.26/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.25/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.26/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.26/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.26/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.26/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.26/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.26/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.26/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.26/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.26/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.26/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.26/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.26/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.26/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.26/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.26/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.26/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.26/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.26/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.26/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.26/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.26/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.26/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.26/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.26/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.26/conv/_weight_quantizer/Constant [Constant] outputs: [/model.26/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.26/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.26/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.26/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.26/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.26/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.26.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.26/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.26/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.26/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.26.conv.weight -> (256, 256, 3, 3)[FLOAT]], [/model.26/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.26/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.26.conv.weight for ONNX node: model.26.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.26/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.26/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.26/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.26/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.26/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.26/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.26/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.26/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 256, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.26/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.26/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.26/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.26/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.26/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.26/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 256, 3, 3)[FLOAT]], [/model.26/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.26/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.26/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.26/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.26/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.26/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 256, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.26/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.26/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.26/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.26.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.26/conv/Conv [Conv] inputs: [/model.26/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.26/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 256, 3, 3)[FLOAT]], [model.26.conv.bias -> (256)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.26/conv/Conv for ONNX node: /model.26/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.26/conv/Conv_output_0 for ONNX tensor: /model.26/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.26/conv/Conv [Conv] outputs: [/model.26/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.26/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.26/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.26/act/LeakyRelu [LeakyRelu] inputs: [/model.26/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.26/act/LeakyRelu for ONNX node: /model.26/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.26/act/LeakyRelu_output_0 for ONNX tensor: /model.26/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.26/act/LeakyRelu [LeakyRelu] outputs: [/model.26/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.27/Concat [Concat] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.26/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.25/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.24/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.23/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.27/Concat [Concat] inputs: [/model.26/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.25/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.24/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.23/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.27/Concat for ONNX node: /model.27/Concat [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.27/Concat_output_0 for ONNX tensor: /model.27/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.27/Concat [Concat] outputs: [/model.27/Concat_output_0 -> (1, 1024, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.28/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.28/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.28/conv/_input_quantizer/Constant [Constant] outputs: [/model.28/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.28/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.28/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.28/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.28/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.28/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.27/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.28/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.28/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.28/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.27/Concat_output_0 -> (1, 1024, 20, 20)[FLOAT]], [/model.28/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.28/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.28/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.28/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.28/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.28/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.28/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.28/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.28/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.28/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 1024, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.28/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.28/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.28/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.28/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.28/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.28/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 1024, 20, 20)[FLOAT]], [/model.28/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.28/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.28/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.28/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.28/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.28/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 1024, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.28/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.28/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.28/conv/_weight_quantizer/Constant [Constant] outputs: [/model.28/conv/_weight_quantizer/Constant_output_0 -> (512)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.28/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.28/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.28/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.28/conv/_weight_quantizer/Constant_1_output_0 -> (512)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.28/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.28.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.28/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.28/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.28/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.28.conv.weight -> (512, 1024, 1, 1)[FLOAT]], [/model.28/conv/_weight_quantizer/Constant_output_0 -> (512)[FLOAT]], [/model.28/conv/_weight_quantizer/Constant_1_output_0 -> (512)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.28.conv.weight for ONNX node: model.28.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.28/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.28/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.28/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.28/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.28/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.28/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.28/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.28/conv/_weight_quantizer/QuantizeLinear_output_0 -> (512, 1024, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.28/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.28/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.28/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.28/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.28/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.28/conv/_weight_quantizer/QuantizeLinear_output_0 -> (512, 1024, 1, 1)[FLOAT]], [/model.28/conv/_weight_quantizer/Constant_output_0 -> (512)[FLOAT]], [/model.28/conv/_weight_quantizer/Constant_1_output_0 -> (512)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.28/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.28/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.28/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.28/conv/_weight_quantizer/DequantizeLinear_output_0 -> (512, 1024, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.28/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.28/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.28/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.28.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.28/conv/Conv [Conv] inputs: [/model.28/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 1024, 20, 20)[FLOAT]], [/model.28/conv/_weight_quantizer/DequantizeLinear_output_0 -> (512, 1024, 1, 1)[FLOAT]], [model.28.conv.bias -> (512)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.28/conv/Conv for ONNX node: /model.28/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.28/conv/Conv_output_0 for ONNX tensor: /model.28/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.28/conv/Conv [Conv] outputs: [/model.28/conv/Conv_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.28/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.28/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.28/act/LeakyRelu [LeakyRelu] inputs: [/model.28/conv/Conv_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.28/act/LeakyRelu for ONNX node: /model.28/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.28/act/LeakyRelu_output_0 for ONNX tensor: /model.28/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.28/act/LeakyRelu [LeakyRelu] outputs: [/model.28/act/LeakyRelu_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.29/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.29/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.29/conv/_input_quantizer/Constant [Constant] outputs: [/model.29/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.29/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.29/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.29/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.29/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.29/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.28/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.29/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.29/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.29/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.28/act/LeakyRelu_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.29/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.29/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.29/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.29/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.29/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.29/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.29/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.29/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.29/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.29/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.29/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.29/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.29/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.29/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.29/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.29/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.29/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.29/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.29/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.29/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.29/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.29/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.29/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.29/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.29/conv/_weight_quantizer/Constant [Constant] outputs: [/model.29/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.29/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.29/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.29/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.29/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.29/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.29.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.29/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.29/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.29/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.29.conv.weight -> (256, 512, 1, 1)[FLOAT]], [/model.29/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.29/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.29.conv.weight for ONNX node: model.29.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.29/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.29/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.29/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.29/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.29/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.29/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.29/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.29/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.29/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.29/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.29/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.29/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.29/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.29/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [/model.29/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.29/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.29/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.29/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.29/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.29/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.29/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.29/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.29/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.29.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.29/conv/Conv [Conv] inputs: [/model.29/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.29/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [model.29.conv.bias -> (256)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.29/conv/Conv for ONNX node: /model.29/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.29/conv/Conv_output_0 for ONNX tensor: /model.29/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.29/conv/Conv [Conv] outputs: [/model.29/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.29/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.29/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.29/act/LeakyRelu [LeakyRelu] inputs: [/model.29/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.29/act/LeakyRelu for ONNX node: /model.29/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.29/act/LeakyRelu_output_0 for ONNX tensor: /model.29/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.29/act/LeakyRelu [LeakyRelu] outputs: [/model.29/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.30/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.30/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.30/conv/_input_quantizer/Constant [Constant] outputs: [/model.30/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.30/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.30/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.30/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.30/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.30/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.28/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.30/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.30/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.30/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.28/act/LeakyRelu_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.30/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.30/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.30/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.30/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.30/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.30/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.30/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.30/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.30/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.30/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.30/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.30/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.30/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.30/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.30/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.30/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.30/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.30/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.30/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.30/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.30/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.30/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.30/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.30/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.30/conv/_weight_quantizer/Constant [Constant] outputs: [/model.30/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.30/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.30/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.30/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.30/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.30/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.30.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.30/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.30/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.30/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.30.conv.weight -> (256, 512, 1, 1)[FLOAT]], [/model.30/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.30/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.30.conv.weight for ONNX node: model.30.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.30/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.30/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.30/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.30/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.30/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.30/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.30/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.30/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.30/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.30/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.30/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.30/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.30/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.30/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [/model.30/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.30/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.30/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.30/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.30/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.30/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.30/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.30/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.30/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.30.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.30/conv/Conv [Conv] inputs: [/model.30/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.30/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [model.30.conv.bias -> (256)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.30/conv/Conv for ONNX node: /model.30/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.30/conv/Conv_output_0 for ONNX tensor: /model.30/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.30/conv/Conv [Conv] outputs: [/model.30/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.30/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.30/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.30/act/LeakyRelu [LeakyRelu] inputs: [/model.30/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.30/act/LeakyRelu for ONNX node: /model.30/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.30/act/LeakyRelu_output_0 for ONNX tensor: /model.30/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.30/act/LeakyRelu [LeakyRelu] outputs: [/model.30/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.31/m/MaxPool [MaxPool] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.30/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.31/m/MaxPool [MaxPool] inputs: [/model.30/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.31/m/MaxPool for ONNX node: /model.31/m/MaxPool [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.31/m/MaxPool_output_0 for ONNX tensor: /model.31/m/MaxPool_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.31/m/MaxPool [MaxPool] outputs: [/model.31/m/MaxPool_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.32/m/MaxPool [MaxPool] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.30/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.32/m/MaxPool [MaxPool] inputs: [/model.30/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.32/m/MaxPool for ONNX node: /model.32/m/MaxPool [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.32/m/MaxPool_output_0 for ONNX tensor: /model.32/m/MaxPool_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.32/m/MaxPool [MaxPool] outputs: [/model.32/m/MaxPool_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.33/m/MaxPool [MaxPool] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.30/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.33/m/MaxPool [MaxPool] inputs: [/model.30/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.33/m/MaxPool for ONNX node: /model.33/m/MaxPool [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.33/m/MaxPool_output_0 for ONNX tensor: /model.33/m/MaxPool_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.33/m/MaxPool [MaxPool] outputs: [/model.33/m/MaxPool_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.34/Concat [Concat] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.33/m/MaxPool_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.32/m/MaxPool_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.31/m/MaxPool_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.30/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.34/Concat [Concat] inputs: [/model.33/m/MaxPool_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.32/m/MaxPool_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.31/m/MaxPool_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.30/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.34/Concat for ONNX node: /model.34/Concat [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.34/Concat_output_0 for ONNX tensor: /model.34/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.34/Concat [Concat] outputs: [/model.34/Concat_output_0 -> (1, 1024, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.35/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.35/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.35/conv/_input_quantizer/Constant [Constant] outputs: [/model.35/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.35/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.35/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.35/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.35/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.35/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.34/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.35/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.35/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.35/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.34/Concat_output_0 -> (1, 1024, 20, 20)[FLOAT]], [/model.35/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.35/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.35/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.35/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.35/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.35/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.35/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.35/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.35/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.35/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 1024, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.35/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.35/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.35/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.35/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.35/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.35/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 1024, 20, 20)[FLOAT]], [/model.35/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.35/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.35/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.35/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.35/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.35/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 1024, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.35/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.35/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.35/conv/_weight_quantizer/Constant [Constant] outputs: [/model.35/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.35/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.35/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.35/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.35/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.35/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.35.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.35/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.35/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.35/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.35.conv.weight -> (256, 1024, 1, 1)[FLOAT]], [/model.35/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.35/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.35.conv.weight for ONNX node: model.35.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.35/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.35/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.35/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.35/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.35/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.35/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.35/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.35/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 1024, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.35/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.35/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.35/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.35/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.35/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.35/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 1024, 1, 1)[FLOAT]], [/model.35/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.35/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.35/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.35/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.35/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.35/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 1024, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.35/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.35/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.35/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.35.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.35/conv/Conv [Conv] inputs: [/model.35/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 1024, 20, 20)[FLOAT]], [/model.35/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 1024, 1, 1)[FLOAT]], [model.35.conv.bias -> (256)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.35/conv/Conv for ONNX node: /model.35/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.35/conv/Conv_output_0 for ONNX tensor: /model.35/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.35/conv/Conv [Conv] outputs: [/model.35/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.35/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.35/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.35/act/LeakyRelu [LeakyRelu] inputs: [/model.35/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.35/act/LeakyRelu for ONNX node: /model.35/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.35/act/LeakyRelu_output_0 for ONNX tensor: /model.35/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.35/act/LeakyRelu [LeakyRelu] outputs: [/model.35/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.36/Concat [Concat] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.35/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.29/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.36/Concat [Concat] inputs: [/model.35/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.29/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.36/Concat for ONNX node: /model.36/Concat [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.36/Concat_output_0 for ONNX tensor: /model.36/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.36/Concat [Concat] outputs: [/model.36/Concat_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.37/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.37/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.37/conv/_input_quantizer/Constant [Constant] outputs: [/model.37/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.37/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.37/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.37/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.37/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.37/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.36/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.37/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.37/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.37/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.36/Concat_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.37/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.37/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.37/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.37/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.37/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.37/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.37/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.37/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.37/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.37/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.37/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.37/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.37/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.37/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.37/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.37/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.37/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.37/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.37/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.37/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.37/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.37/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.37/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.37/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.37/conv/_weight_quantizer/Constant [Constant] outputs: [/model.37/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.37/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.37/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.37/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.37/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.37/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.37.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.37/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.37/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.37/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.37.conv.weight -> (256, 512, 1, 1)[FLOAT]], [/model.37/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.37/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.37.conv.weight for ONNX node: model.37.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.37/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.37/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.37/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.37/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.37/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.37/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.37/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.37/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.37/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.37/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.37/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.37/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.37/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.37/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [/model.37/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.37/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.37/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.37/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.37/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.37/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.37/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.37/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.37/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.37.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.37/conv/Conv [Conv] inputs: [/model.37/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.37/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [model.37.conv.bias -> (256)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.37/conv/Conv for ONNX node: /model.37/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.37/conv/Conv_output_0 for ONNX tensor: /model.37/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.37/conv/Conv [Conv] outputs: [/model.37/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.37/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.37/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.37/act/LeakyRelu [LeakyRelu] inputs: [/model.37/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.37/act/LeakyRelu for ONNX node: /model.37/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.37/act/LeakyRelu_output_0 for ONNX tensor: /model.37/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.37/act/LeakyRelu [LeakyRelu] outputs: [/model.37/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.38/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.38/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.38/conv/_input_quantizer/Constant [Constant] outputs: [/model.38/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.38/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.38/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.38/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.38/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.38/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.37/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.38/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.38/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.38/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.37/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.38/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.38/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.38/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.38/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.38/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.38/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.38/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.38/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.38/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.38/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.38/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.38/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.38/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.38/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.38/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.38/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.38/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.38/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.38/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.38/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.38/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.38/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.38/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.38/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.38/conv/_weight_quantizer/Constant [Constant] outputs: [/model.38/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.38/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.38/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.38/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.38/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.38/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.38.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.38/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.38/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.38/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.38.conv.weight -> (128, 256, 1, 1)[FLOAT]], [/model.38/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.38/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.38.conv.weight for ONNX node: model.38.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.38/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.38/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.38/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.38/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.38/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.38/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.38/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.38/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.38/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.38/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.38/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.38/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.38/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.38/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [/model.38/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.38/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.38/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.38/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.38/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.38/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.38/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.38/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.38/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.38.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.38/conv/Conv [Conv] inputs: [/model.38/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.38/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [model.38.conv.bias -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.38/conv/Conv for ONNX node: /model.38/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.38/conv/Conv_output_0 for ONNX tensor: /model.38/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.38/conv/Conv [Conv] outputs: [/model.38/conv/Conv_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.38/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.38/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.38/act/LeakyRelu [LeakyRelu] inputs: [/model.38/conv/Conv_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.38/act/LeakyRelu for ONNX node: /model.38/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.38/act/LeakyRelu_output_0 for ONNX tensor: /model.38/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.38/act/LeakyRelu [LeakyRelu] outputs: [/model.38/act/LeakyRelu_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.39/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.39/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.39/Constant [Constant] outputs: [/model.39/Constant_output_0 -> (4)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.39/Resize [Resize] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.38/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.39/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.39/Resize [Resize] inputs: [/model.38/act/LeakyRelu_output_0 -> (1, 128, 20, 20)[FLOAT]], [optional input, not set], [/model.39/Constant_output_0 -> (4)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.39/Resize for ONNX node: /model.39/Resize [04/18/2023-13:39:19] [V] [TRT] Running resize layer with: Transformation mode: asymmetric Resize mode: nearest [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.39/Resize_output_0 for ONNX tensor: /model.39/Resize_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.39/Resize [Resize] outputs: [/model.39/Resize_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.40/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.40/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.40/conv/_input_quantizer/Constant [Constant] outputs: [/model.40/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.40/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.40/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.40/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.40/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.40/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.21/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.40/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.40/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.40/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.21/act/LeakyRelu_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.40/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.40/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.40/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.40/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.40/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.40/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.40/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.40/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.40/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.40/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.40/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.40/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.40/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.40/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.40/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.40/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.40/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.40/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.40/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.40/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.40/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.40/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.40/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.40/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.40/conv/_weight_quantizer/Constant [Constant] outputs: [/model.40/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.40/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.40/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.40/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.40/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.40/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.40.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.40/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.40/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.40/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.40.conv.weight -> (128, 256, 1, 1)[FLOAT]], [/model.40/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.40/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.40.conv.weight for ONNX node: model.40.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.40/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.40/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.40/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.40/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.40/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.40/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.40/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.40/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.40/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.40/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.40/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.40/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.40/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.40/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [/model.40/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.40/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.40/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.40/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.40/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.40/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.40/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.40/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.40/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.40.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.40/conv/Conv [Conv] inputs: [/model.40/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.40/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [model.40.conv.bias -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.40/conv/Conv for ONNX node: /model.40/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.40/conv/Conv_output_0 for ONNX tensor: /model.40/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.40/conv/Conv [Conv] outputs: [/model.40/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.40/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.40/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.40/act/LeakyRelu [LeakyRelu] inputs: [/model.40/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.40/act/LeakyRelu for ONNX node: /model.40/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.40/act/LeakyRelu_output_0 for ONNX tensor: /model.40/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.40/act/LeakyRelu [LeakyRelu] outputs: [/model.40/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.41/Concat [Concat] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.40/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.39/Resize_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.41/Concat [Concat] inputs: [/model.40/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.39/Resize_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.41/Concat for ONNX node: /model.41/Concat [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.41/Concat_output_0 for ONNX tensor: /model.41/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.41/Concat [Concat] outputs: [/model.41/Concat_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.42/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.42/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.42/conv/_input_quantizer/Constant [Constant] outputs: [/model.42/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.42/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.42/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.42/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.42/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.42/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.41/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.42/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.42/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.42/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.41/Concat_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.42/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.42/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.42/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.42/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.42/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.42/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.42/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.42/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.42/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.42/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.42/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.42/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.42/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.42/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.42/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.42/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.42/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.42/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.42/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.42/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.42/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.42/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.42/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.42/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.42/conv/_weight_quantizer/Constant [Constant] outputs: [/model.42/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.42/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.42/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.42/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.42/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.42/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.42.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.42/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.42/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.42/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.42.conv.weight -> (64, 256, 1, 1)[FLOAT]], [/model.42/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.42/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.42.conv.weight for ONNX node: model.42.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.42/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.42/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.42/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.42/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.42/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.42/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.42/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.42/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.42/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.42/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.42/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.42/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.42/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.42/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [/model.42/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.42/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.42/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.42/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.42/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.42/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.42/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.42/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.42/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.42.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.42/conv/Conv [Conv] inputs: [/model.42/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.42/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [model.42.conv.bias -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.42/conv/Conv for ONNX node: /model.42/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.42/conv/Conv_output_0 for ONNX tensor: /model.42/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.42/conv/Conv [Conv] outputs: [/model.42/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.42/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.42/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.42/act/LeakyRelu [LeakyRelu] inputs: [/model.42/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.42/act/LeakyRelu for ONNX node: /model.42/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.42/act/LeakyRelu_output_0 for ONNX tensor: /model.42/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.42/act/LeakyRelu [LeakyRelu] outputs: [/model.42/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.43/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.43/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.43/conv/_weight_quantizer/Constant [Constant] outputs: [/model.43/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.43/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.43/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.43/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.43/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.43/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.43.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.43/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.43/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.43/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.43.conv.weight -> (64, 256, 1, 1)[FLOAT]], [/model.43/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.43/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.43.conv.weight for ONNX node: model.43.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.43/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.43/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.43/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.43/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.43/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.43/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.43/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.43/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.43/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.43/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.43/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.43/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.43/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.43/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [/model.43/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.43/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.43/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.43/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.43/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.43/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.43/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.42/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.43/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.43.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.43/conv/Conv [Conv] inputs: [/model.42/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.43/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [model.43.conv.bias -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.43/conv/Conv for ONNX node: /model.43/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.43/conv/Conv_output_0 for ONNX tensor: /model.43/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.43/conv/Conv [Conv] outputs: [/model.43/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.43/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.43/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.43/act/LeakyRelu [LeakyRelu] inputs: [/model.43/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.43/act/LeakyRelu for ONNX node: /model.43/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.43/act/LeakyRelu_output_0 for ONNX tensor: /model.43/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.43/act/LeakyRelu [LeakyRelu] outputs: [/model.43/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.44/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.44/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.44/conv/_input_quantizer/Constant [Constant] outputs: [/model.44/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.44/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.44/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.44/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.44/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.44/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.43/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.44/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.44/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.44/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.43/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.44/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.44/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.44/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.44/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.44/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.44/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.44/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.44/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.44/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.44/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.44/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.44/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.44/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.44/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.44/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.44/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.44/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.44/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.44/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.44/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.44/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.44/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.44/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.44/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.44/conv/_weight_quantizer/Constant [Constant] outputs: [/model.44/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.44/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.44/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.44/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.44/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.44/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.44.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.44/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.44/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.44/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.44.conv.weight -> (64, 64, 3, 3)[FLOAT]], [/model.44/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.44/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.44.conv.weight for ONNX node: model.44.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.44/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.44/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.44/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.44/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.44/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.44/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.44/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.44/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.44/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.44/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.44/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.44/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.44/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.44/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [/model.44/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.44/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.44/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.44/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.44/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.44/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.44/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.44/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.44/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.44.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.44/conv/Conv [Conv] inputs: [/model.44/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.44/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [model.44.conv.bias -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.44/conv/Conv for ONNX node: /model.44/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.44/conv/Conv_output_0 for ONNX tensor: /model.44/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.44/conv/Conv [Conv] outputs: [/model.44/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.44/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.44/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.44/act/LeakyRelu [LeakyRelu] inputs: [/model.44/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.44/act/LeakyRelu for ONNX node: /model.44/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.44/act/LeakyRelu_output_0 for ONNX tensor: /model.44/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.44/act/LeakyRelu [LeakyRelu] outputs: [/model.44/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.45/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.45/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.45/conv/_input_quantizer/Constant [Constant] outputs: [/model.45/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.45/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.45/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.45/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.45/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.45/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.44/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.45/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.45/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.45/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.44/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.45/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.45/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.45/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.45/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.45/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.45/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.45/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.45/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.45/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.45/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.45/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.45/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.45/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.45/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.45/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.45/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.45/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.45/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.45/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.45/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.45/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.45/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.45/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.45/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.45/conv/_weight_quantizer/Constant [Constant] outputs: [/model.45/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.45/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.45/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.45/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.45/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.45/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.45.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.45/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.45/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.45/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.45.conv.weight -> (64, 64, 3, 3)[FLOAT]], [/model.45/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.45/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.45.conv.weight for ONNX node: model.45.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.45/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.45/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.45/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.45/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.45/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.45/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.45/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.45/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.45/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.45/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.45/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.45/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.45/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.45/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [/model.45/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.45/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.45/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.45/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.45/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.45/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.45/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.45/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.45/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.45.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.45/conv/Conv [Conv] inputs: [/model.45/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.45/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [model.45.conv.bias -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.45/conv/Conv for ONNX node: /model.45/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.45/conv/Conv_output_0 for ONNX tensor: /model.45/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.45/conv/Conv [Conv] outputs: [/model.45/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.45/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.45/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.45/act/LeakyRelu [LeakyRelu] inputs: [/model.45/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.45/act/LeakyRelu for ONNX node: /model.45/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.45/act/LeakyRelu_output_0 for ONNX tensor: /model.45/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.45/act/LeakyRelu [LeakyRelu] outputs: [/model.45/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.46/Concat [Concat] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.45/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.44/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.43/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.42/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.46/Concat [Concat] inputs: [/model.45/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.44/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.43/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.42/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.46/Concat for ONNX node: /model.46/Concat [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.46/Concat_output_0 for ONNX tensor: /model.46/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.46/Concat [Concat] outputs: [/model.46/Concat_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.47/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.47/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.47/conv/_input_quantizer/Constant [Constant] outputs: [/model.47/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.47/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.47/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.47/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.47/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.47/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.46/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.47/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.47/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.47/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.46/Concat_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.47/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.47/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.47/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.47/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.47/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.47/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.47/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.47/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.47/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.47/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.47/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.47/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.47/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.47/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.47/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.47/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.47/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.47/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.47/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.47/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.47/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.47/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.47/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.47/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.47/conv/_weight_quantizer/Constant [Constant] outputs: [/model.47/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.47/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.47/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.47/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.47/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.47/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.47.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.47/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.47/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.47/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.47.conv.weight -> (128, 256, 1, 1)[FLOAT]], [/model.47/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.47/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.47.conv.weight for ONNX node: model.47.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.47/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.47/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.47/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.47/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.47/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.47/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.47/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.47/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.47/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.47/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.47/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.47/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.47/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.47/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [/model.47/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.47/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.47/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.47/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.47/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.47/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.47/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.47/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.47/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.47.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.47/conv/Conv [Conv] inputs: [/model.47/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.47/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [model.47.conv.bias -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.47/conv/Conv for ONNX node: /model.47/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.47/conv/Conv_output_0 for ONNX tensor: /model.47/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.47/conv/Conv [Conv] outputs: [/model.47/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.47/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.47/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.47/act/LeakyRelu [LeakyRelu] inputs: [/model.47/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.47/act/LeakyRelu for ONNX node: /model.47/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.47/act/LeakyRelu_output_0 for ONNX tensor: /model.47/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.47/act/LeakyRelu [LeakyRelu] outputs: [/model.47/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.48/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.48/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.48/conv/_input_quantizer/Constant [Constant] outputs: [/model.48/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.48/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.48/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.48/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.48/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.48/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.47/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.48/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.48/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.48/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.47/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.48/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.48/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.48/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.48/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.48/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.48/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.48/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.48/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.48/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.48/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.48/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.48/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.48/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.48/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.48/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.48/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.48/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.48/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.48/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.48/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.48/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.48/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.48/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.48/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.48/conv/_weight_quantizer/Constant [Constant] outputs: [/model.48/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.48/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.48/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.48/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.48/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.48/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.48.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.48/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.48/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.48/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.48.conv.weight -> (64, 128, 1, 1)[FLOAT]], [/model.48/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.48/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.48.conv.weight for ONNX node: model.48.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.48/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.48/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.48/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.48/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.48/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.48/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.48/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.48/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.48/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.48/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.48/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.48/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.48/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.48/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [/model.48/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.48/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.48/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.48/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.48/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.48/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.48/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.48/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.48/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.48.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.48/conv/Conv [Conv] inputs: [/model.48/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.48/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [model.48.conv.bias -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.48/conv/Conv for ONNX node: /model.48/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.48/conv/Conv_output_0 for ONNX tensor: /model.48/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.48/conv/Conv [Conv] outputs: [/model.48/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.48/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.48/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.48/act/LeakyRelu [LeakyRelu] inputs: [/model.48/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.48/act/LeakyRelu for ONNX node: /model.48/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.48/act/LeakyRelu_output_0 for ONNX tensor: /model.48/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.48/act/LeakyRelu [LeakyRelu] outputs: [/model.48/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.49/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.49/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.49/Constant [Constant] outputs: [/model.49/Constant_output_0 -> (4)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.49/Resize [Resize] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.48/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.49/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.49/Resize [Resize] inputs: [/model.48/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [optional input, not set], [/model.49/Constant_output_0 -> (4)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.49/Resize for ONNX node: /model.49/Resize [04/18/2023-13:39:19] [V] [TRT] Running resize layer with: Transformation mode: asymmetric Resize mode: nearest [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.49/Resize_output_0 for ONNX tensor: /model.49/Resize_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.49/Resize [Resize] outputs: [/model.49/Resize_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.50/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.50/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.50/conv/_input_quantizer/Constant [Constant] outputs: [/model.50/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.50/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.50/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.50/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.50/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.50/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.14/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.50/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.50/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.50/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.14/act/LeakyRelu_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.50/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.50/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.50/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.50/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.50/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.50/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.50/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.50/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.50/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.50/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.50/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.50/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.50/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.50/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.50/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.50/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.50/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.50/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.50/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.50/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.50/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.50/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.50/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.50/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.50/conv/_weight_quantizer/Constant [Constant] outputs: [/model.50/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.50/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.50/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.50/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.50/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.50/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.50.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.50/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.50/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.50/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.50.conv.weight -> (64, 128, 1, 1)[FLOAT]], [/model.50/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.50/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.50.conv.weight for ONNX node: model.50.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.50/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.50/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.50/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.50/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.50/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.50/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.50/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.50/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.50/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.50/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.50/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.50/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.50/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.50/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [/model.50/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.50/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.50/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.50/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.50/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.50/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.50/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.50/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.50/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.50.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.50/conv/Conv [Conv] inputs: [/model.50/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.50/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [model.50.conv.bias -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.50/conv/Conv for ONNX node: /model.50/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.50/conv/Conv_output_0 for ONNX tensor: /model.50/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.50/conv/Conv [Conv] outputs: [/model.50/conv/Conv_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.50/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.50/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.50/act/LeakyRelu [LeakyRelu] inputs: [/model.50/conv/Conv_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.50/act/LeakyRelu for ONNX node: /model.50/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.50/act/LeakyRelu_output_0 for ONNX tensor: /model.50/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.50/act/LeakyRelu [LeakyRelu] outputs: [/model.50/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.51/Concat [Concat] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.50/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.49/Resize_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.51/Concat [Concat] inputs: [/model.50/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.49/Resize_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.51/Concat for ONNX node: /model.51/Concat [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.51/Concat_output_0 for ONNX tensor: /model.51/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.51/Concat [Concat] outputs: [/model.51/Concat_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.52/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.52/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.52/conv/_input_quantizer/Constant [Constant] outputs: [/model.52/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.52/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.52/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.52/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.52/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.52/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.51/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.52/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.52/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.52/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.51/Concat_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.52/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.52/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.52/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.52/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.52/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.52/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.52/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.52/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.52/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.52/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.52/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.52/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.52/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.52/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.52/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.52/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.52/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.52/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.52/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.52/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.52/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.52/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.52/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.52/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.52/conv/_weight_quantizer/Constant [Constant] outputs: [/model.52/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.52/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.52/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.52/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.52/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.52/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.52.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.52/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.52/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.52/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.52.conv.weight -> (32, 128, 1, 1)[FLOAT]], [/model.52/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.52/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.52.conv.weight for ONNX node: model.52.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.52/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.52/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.52/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.52/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.52/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.52/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.52/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.52/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 128, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.52/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.52/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.52/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.52/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.52/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.52/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 128, 1, 1)[FLOAT]], [/model.52/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.52/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.52/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.52/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.52/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.52/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 128, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.52/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.52/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.52/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.52.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.52/conv/Conv [Conv] inputs: [/model.52/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.52/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 128, 1, 1)[FLOAT]], [model.52.conv.bias -> (32)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.52/conv/Conv for ONNX node: /model.52/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.52/conv/Conv_output_0 for ONNX tensor: /model.52/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.52/conv/Conv [Conv] outputs: [/model.52/conv/Conv_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.52/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.52/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.52/act/LeakyRelu [LeakyRelu] inputs: [/model.52/conv/Conv_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.52/act/LeakyRelu for ONNX node: /model.52/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.52/act/LeakyRelu_output_0 for ONNX tensor: /model.52/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.52/act/LeakyRelu [LeakyRelu] outputs: [/model.52/act/LeakyRelu_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.53/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.53/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.53/conv/_weight_quantizer/Constant [Constant] outputs: [/model.53/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.53/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.53/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.53/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.53/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.53/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.53.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.53/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.53/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.53/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.53.conv.weight -> (32, 128, 1, 1)[FLOAT]], [/model.53/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.53/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.53.conv.weight for ONNX node: model.53.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.53/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.53/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.53/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.53/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.53/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.53/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.53/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.53/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 128, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.53/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.53/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.53/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.53/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.53/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.53/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 128, 1, 1)[FLOAT]], [/model.53/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.53/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.53/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.53/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.53/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.53/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 128, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.53/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.52/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.53/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.53.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.53/conv/Conv [Conv] inputs: [/model.52/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.53/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 128, 1, 1)[FLOAT]], [model.53.conv.bias -> (32)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.53/conv/Conv for ONNX node: /model.53/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.53/conv/Conv_output_0 for ONNX tensor: /model.53/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.53/conv/Conv [Conv] outputs: [/model.53/conv/Conv_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.53/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.53/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.53/act/LeakyRelu [LeakyRelu] inputs: [/model.53/conv/Conv_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.53/act/LeakyRelu for ONNX node: /model.53/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.53/act/LeakyRelu_output_0 for ONNX tensor: /model.53/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.53/act/LeakyRelu [LeakyRelu] outputs: [/model.53/act/LeakyRelu_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.54/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.54/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.54/conv/_input_quantizer/Constant [Constant] outputs: [/model.54/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.54/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.54/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.54/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.54/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.54/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.53/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.54/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.54/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.54/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.53/act/LeakyRelu_output_0 -> (1, 32, 80, 80)[FLOAT]], [/model.54/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.54/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.54/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.54/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.54/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.54/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.54/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.54/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.54/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.54/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.54/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.54/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.54/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.54/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.54/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.54/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 32, 80, 80)[FLOAT]], [/model.54/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.54/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.54/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.54/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.54/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.54/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.54/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.54/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.54/conv/_weight_quantizer/Constant [Constant] outputs: [/model.54/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.54/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.54/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.54/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.54/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.54/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.54.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.54/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.54/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.54/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.54.conv.weight -> (32, 32, 3, 3)[FLOAT]], [/model.54/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.54/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.54.conv.weight for ONNX node: model.54.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.54/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.54/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.54/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.54/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.54/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.54/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.54/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.54/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.54/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.54/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.54/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.54/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.54/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.54/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [/model.54/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.54/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.54/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.54/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.54/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.54/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.54/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.54/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.54/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.54.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.54/conv/Conv [Conv] inputs: [/model.54/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 32, 80, 80)[FLOAT]], [/model.54/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [model.54.conv.bias -> (32)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.54/conv/Conv for ONNX node: /model.54/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.54/conv/Conv_output_0 for ONNX tensor: /model.54/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.54/conv/Conv [Conv] outputs: [/model.54/conv/Conv_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.54/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.54/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.54/act/LeakyRelu [LeakyRelu] inputs: [/model.54/conv/Conv_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.54/act/LeakyRelu for ONNX node: /model.54/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.54/act/LeakyRelu_output_0 for ONNX tensor: /model.54/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.54/act/LeakyRelu [LeakyRelu] outputs: [/model.54/act/LeakyRelu_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.55/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.55/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.55/conv/_input_quantizer/Constant [Constant] outputs: [/model.55/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.55/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.55/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.55/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.55/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.55/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.54/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.55/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.55/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.55/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.54/act/LeakyRelu_output_0 -> (1, 32, 80, 80)[FLOAT]], [/model.55/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.55/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.55/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.55/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.55/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.55/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.55/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.55/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.55/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.55/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.55/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.55/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.55/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.55/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.55/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.55/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 32, 80, 80)[FLOAT]], [/model.55/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.55/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.55/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.55/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.55/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.55/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.55/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.55/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.55/conv/_weight_quantizer/Constant [Constant] outputs: [/model.55/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.55/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.55/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.55/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.55/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.55/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.55.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.55/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.55/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.55/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.55.conv.weight -> (32, 32, 3, 3)[FLOAT]], [/model.55/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.55/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.55.conv.weight for ONNX node: model.55.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.55/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.55/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.55/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.55/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.55/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.55/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.55/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.55/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.55/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.55/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.55/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.55/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.55/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.55/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [/model.55/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.55/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.55/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.55/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.55/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.55/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.55/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.55/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.55/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.55.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.55/conv/Conv [Conv] inputs: [/model.55/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 32, 80, 80)[FLOAT]], [/model.55/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [model.55.conv.bias -> (32)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.55/conv/Conv for ONNX node: /model.55/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.55/conv/Conv_output_0 for ONNX tensor: /model.55/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.55/conv/Conv [Conv] outputs: [/model.55/conv/Conv_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.55/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.55/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.55/act/LeakyRelu [LeakyRelu] inputs: [/model.55/conv/Conv_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.55/act/LeakyRelu for ONNX node: /model.55/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.55/act/LeakyRelu_output_0 for ONNX tensor: /model.55/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.55/act/LeakyRelu [LeakyRelu] outputs: [/model.55/act/LeakyRelu_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.56/Concat [Concat] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.55/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.54/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.53/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.52/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.56/Concat [Concat] inputs: [/model.55/act/LeakyRelu_output_0 -> (1, 32, 80, 80)[FLOAT]], [/model.54/act/LeakyRelu_output_0 -> (1, 32, 80, 80)[FLOAT]], [/model.53/act/LeakyRelu_output_0 -> (1, 32, 80, 80)[FLOAT]], [/model.52/act/LeakyRelu_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.56/Concat for ONNX node: /model.56/Concat [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.56/Concat_output_0 for ONNX tensor: /model.56/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.56/Concat [Concat] outputs: [/model.56/Concat_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.57/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.57/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.57/conv/_input_quantizer/Constant [Constant] outputs: [/model.57/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.57/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.57/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.57/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.57/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.57/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.56/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.57/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.57/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.57/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.56/Concat_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.57/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.57/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.57/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.57/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.57/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.57/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.57/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.57/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.57/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.57/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.57/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.57/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.57/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.57/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.57/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.57/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.57/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.57/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.57/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.57/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.57/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.57/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.57/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.57/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.57/conv/_weight_quantizer/Constant [Constant] outputs: [/model.57/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.57/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.57/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.57/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.57/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.57/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.57.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.57/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.57/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.57/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.57.conv.weight -> (64, 128, 1, 1)[FLOAT]], [/model.57/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.57/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.57.conv.weight for ONNX node: model.57.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.57/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.57/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.57/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.57/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.57/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.57/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.57/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.57/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.57/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.57/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.57/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.57/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.57/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.57/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [/model.57/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.57/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.57/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.57/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.57/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.57/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.57/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.57/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.57/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.57.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.57/conv/Conv [Conv] inputs: [/model.57/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.57/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [model.57.conv.bias -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.57/conv/Conv for ONNX node: /model.57/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.57/conv/Conv_output_0 for ONNX tensor: /model.57/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.57/conv/Conv [Conv] outputs: [/model.57/conv/Conv_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.57/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.57/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.57/act/LeakyRelu [LeakyRelu] inputs: [/model.57/conv/Conv_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.57/act/LeakyRelu for ONNX node: /model.57/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.57/act/LeakyRelu_output_0 for ONNX tensor: /model.57/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.57/act/LeakyRelu [LeakyRelu] outputs: [/model.57/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.58/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.58/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.58/conv/_input_quantizer/Constant [Constant] outputs: [/model.58/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.58/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.58/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.58/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.58/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.58/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.57/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.58/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.58/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.58/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.57/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.58/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.58/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.58/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.58/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.58/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.58/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.58/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.58/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.58/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.58/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.58/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.58/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.58/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.58/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.58/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.58/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.58/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.58/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.58/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.58/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.58/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.58/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.58/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.58/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.58/conv/_weight_quantizer/Constant [Constant] outputs: [/model.58/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.58/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.58/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.58/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.58/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.58/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.58.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.58/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.58/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.58/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.58.conv.weight -> (128, 64, 3, 3)[FLOAT]], [/model.58/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.58/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.58.conv.weight for ONNX node: model.58.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.58/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.58/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.58/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.58/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.58/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.58/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.58/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.58/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 64, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.58/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.58/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.58/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.58/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.58/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.58/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 64, 3, 3)[FLOAT]], [/model.58/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.58/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.58/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.58/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.58/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.58/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 64, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.58/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.58/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.58/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.58.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.58/conv/Conv [Conv] inputs: [/model.58/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.58/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 64, 3, 3)[FLOAT]], [model.58.conv.bias -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.58/conv/Conv for ONNX node: /model.58/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.58/conv/Conv_output_0 for ONNX tensor: /model.58/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.58/conv/Conv [Conv] outputs: [/model.58/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.58/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.58/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.58/act/LeakyRelu [LeakyRelu] inputs: [/model.58/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.58/act/LeakyRelu for ONNX node: /model.58/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.58/act/LeakyRelu_output_0 for ONNX tensor: /model.58/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.58/act/LeakyRelu [LeakyRelu] outputs: [/model.58/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.59/Concat [Concat] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.58/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.47/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.59/Concat [Concat] inputs: [/model.58/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.47/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.59/Concat for ONNX node: /model.59/Concat [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.59/Concat_output_0 for ONNX tensor: /model.59/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.59/Concat [Concat] outputs: [/model.59/Concat_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.60/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.60/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.60/conv/_input_quantizer/Constant [Constant] outputs: [/model.60/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.60/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.60/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.60/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.60/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.60/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.59/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.60/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.60/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.60/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.59/Concat_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.60/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.60/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.60/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.60/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.60/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.60/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.60/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.60/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.60/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.60/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.60/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.60/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.60/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.60/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.60/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.60/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.60/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.60/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.60/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.60/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.60/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.60/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.60/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.60/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.60/conv/_weight_quantizer/Constant [Constant] outputs: [/model.60/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.60/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.60/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.60/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.60/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.60/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.60.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.60/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.60/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.60/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.60.conv.weight -> (64, 256, 1, 1)[FLOAT]], [/model.60/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.60/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.60.conv.weight for ONNX node: model.60.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.60/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.60/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.60/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.60/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.60/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.60/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.60/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.60/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.60/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.60/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.60/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.60/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.60/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.60/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [/model.60/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.60/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.60/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.60/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.60/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.60/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.60/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.60/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.60/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.60.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.60/conv/Conv [Conv] inputs: [/model.60/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.60/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [model.60.conv.bias -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.60/conv/Conv for ONNX node: /model.60/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.60/conv/Conv_output_0 for ONNX tensor: /model.60/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.60/conv/Conv [Conv] outputs: [/model.60/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.60/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.60/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.60/act/LeakyRelu [LeakyRelu] inputs: [/model.60/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.60/act/LeakyRelu for ONNX node: /model.60/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.60/act/LeakyRelu_output_0 for ONNX tensor: /model.60/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.60/act/LeakyRelu [LeakyRelu] outputs: [/model.60/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.61/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.61/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.61/conv/_input_quantizer/Constant [Constant] outputs: [/model.61/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.61/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.61/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.61/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.61/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.61/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.59/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.61/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.61/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.61/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.59/Concat_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.61/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.61/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.61/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.61/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.61/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.61/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.61/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.61/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.61/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.61/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.61/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.61/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.61/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.61/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.61/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.61/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.61/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.61/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.61/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.61/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.61/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.61/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.61/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.61/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.61/conv/_weight_quantizer/Constant [Constant] outputs: [/model.61/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.61/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.61/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.61/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.61/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.61/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.61.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.61/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.61/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.61/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.61.conv.weight -> (64, 256, 1, 1)[FLOAT]], [/model.61/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.61/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.61.conv.weight for ONNX node: model.61.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.61/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.61/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.61/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.61/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.61/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.61/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.61/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.61/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.61/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.61/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.61/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.61/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.61/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.61/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [/model.61/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.61/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.61/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.61/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.61/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.61/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.61/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.61/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.61/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.61.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.61/conv/Conv [Conv] inputs: [/model.61/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.61/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [model.61.conv.bias -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.61/conv/Conv for ONNX node: /model.61/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.61/conv/Conv_output_0 for ONNX tensor: /model.61/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.61/conv/Conv [Conv] outputs: [/model.61/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.61/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.61/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.61/act/LeakyRelu [LeakyRelu] inputs: [/model.61/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.61/act/LeakyRelu for ONNX node: /model.61/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.61/act/LeakyRelu_output_0 for ONNX tensor: /model.61/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.61/act/LeakyRelu [LeakyRelu] outputs: [/model.61/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.62/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.62/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.62/conv/_input_quantizer/Constant [Constant] outputs: [/model.62/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.62/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.62/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.62/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.62/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.62/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.61/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.62/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.62/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.62/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.61/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.62/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.62/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.62/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.62/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.62/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.62/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.62/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.62/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.62/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.62/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.62/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.62/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.62/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.62/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.62/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.62/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.62/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.62/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.62/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.62/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.62/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.62/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.62/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.62/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.62/conv/_weight_quantizer/Constant [Constant] outputs: [/model.62/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.62/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.62/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.62/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.62/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.62/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.62.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.62/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.62/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.62/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.62.conv.weight -> (64, 64, 3, 3)[FLOAT]], [/model.62/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.62/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.62.conv.weight for ONNX node: model.62.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.62/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.62/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.62/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.62/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.62/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.62/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.62/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.62/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.62/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.62/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.62/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.62/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.62/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.62/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [/model.62/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.62/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.62/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.62/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.62/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.62/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.62/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.62/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.62/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.62.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.62/conv/Conv [Conv] inputs: [/model.62/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.62/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [model.62.conv.bias -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.62/conv/Conv for ONNX node: /model.62/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.62/conv/Conv_output_0 for ONNX tensor: /model.62/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.62/conv/Conv [Conv] outputs: [/model.62/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.62/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.62/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.62/act/LeakyRelu [LeakyRelu] inputs: [/model.62/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.62/act/LeakyRelu for ONNX node: /model.62/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.62/act/LeakyRelu_output_0 for ONNX tensor: /model.62/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.62/act/LeakyRelu [LeakyRelu] outputs: [/model.62/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.63/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.63/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.63/conv/_input_quantizer/Constant [Constant] outputs: [/model.63/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.63/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.63/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.63/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.63/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.63/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.62/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.63/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.63/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.63/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.62/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.63/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.63/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.63/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.63/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.63/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.63/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.63/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.63/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.63/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.63/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.63/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.63/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.63/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.63/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.63/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.63/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.63/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.63/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.63/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.63/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.63/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.63/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.63/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.63/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.63/conv/_weight_quantizer/Constant [Constant] outputs: [/model.63/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.63/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.63/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.63/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.63/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.63/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.63.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.63/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.63/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.63/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.63.conv.weight -> (64, 64, 3, 3)[FLOAT]], [/model.63/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.63/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.63.conv.weight for ONNX node: model.63.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.63/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.63/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.63/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.63/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.63/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.63/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.63/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.63/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.63/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.63/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.63/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.63/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.63/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.63/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [/model.63/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.63/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.63/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.63/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.63/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.63/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.63/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.63/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.63/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.63.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.63/conv/Conv [Conv] inputs: [/model.63/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.63/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [model.63.conv.bias -> (64)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.63/conv/Conv for ONNX node: /model.63/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.63/conv/Conv_output_0 for ONNX tensor: /model.63/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.63/conv/Conv [Conv] outputs: [/model.63/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.63/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.63/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.63/act/LeakyRelu [LeakyRelu] inputs: [/model.63/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.63/act/LeakyRelu for ONNX node: /model.63/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.63/act/LeakyRelu_output_0 for ONNX tensor: /model.63/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.63/act/LeakyRelu [LeakyRelu] outputs: [/model.63/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.64/Concat [Concat] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.63/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.62/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.61/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.60/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.64/Concat [Concat] inputs: [/model.63/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.62/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.61/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.60/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.64/Concat for ONNX node: /model.64/Concat [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.64/Concat_output_0 for ONNX tensor: /model.64/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.64/Concat [Concat] outputs: [/model.64/Concat_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.65/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.65/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.65/conv/_input_quantizer/Constant [Constant] outputs: [/model.65/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.65/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.65/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.65/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.65/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.65/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.64/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.65/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.65/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.65/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.64/Concat_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.65/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.65/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.65/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.65/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.65/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.65/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.65/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.65/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.65/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.65/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.65/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.65/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.65/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.65/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.65/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.65/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.65/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.65/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.65/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.65/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.65/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.65/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.65/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.65/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.65/conv/_weight_quantizer/Constant [Constant] outputs: [/model.65/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.65/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.65/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.65/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.65/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.65/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.65.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.65/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.65/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.65/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.65.conv.weight -> (128, 256, 1, 1)[FLOAT]], [/model.65/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.65/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.65.conv.weight for ONNX node: model.65.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.65/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.65/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.65/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.65/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.65/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.65/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.65/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.65/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.65/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.65/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.65/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.65/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.65/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.65/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [/model.65/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.65/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.65/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.65/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.65/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.65/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.65/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.65/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.65/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.65.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.65/conv/Conv [Conv] inputs: [/model.65/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.65/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [model.65.conv.bias -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.65/conv/Conv for ONNX node: /model.65/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.65/conv/Conv_output_0 for ONNX tensor: /model.65/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.65/conv/Conv [Conv] outputs: [/model.65/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.65/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.65/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.65/act/LeakyRelu [LeakyRelu] inputs: [/model.65/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.65/act/LeakyRelu for ONNX node: /model.65/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.65/act/LeakyRelu_output_0 for ONNX tensor: /model.65/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.65/act/LeakyRelu [LeakyRelu] outputs: [/model.65/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.66/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.66/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.66/conv/_input_quantizer/Constant [Constant] outputs: [/model.66/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.66/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.66/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.66/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.66/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.66/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.65/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.66/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.66/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.66/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.65/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.66/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.66/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.66/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.66/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.66/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.66/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.66/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.66/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.66/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.66/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.66/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.66/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.66/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.66/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.66/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.66/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.66/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.66/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.66/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.66/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.66/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.66/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.66/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.66/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.66/conv/_weight_quantizer/Constant [Constant] outputs: [/model.66/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.66/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.66/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.66/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.66/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.66/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.66.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.66/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.66/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.66/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.66.conv.weight -> (256, 128, 3, 3)[FLOAT]], [/model.66/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.66/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.66.conv.weight for ONNX node: model.66.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.66/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.66/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.66/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.66/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.66/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.66/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.66/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.66/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 128, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.66/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.66/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.66/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.66/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.66/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.66/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 128, 3, 3)[FLOAT]], [/model.66/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.66/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.66/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.66/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.66/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.66/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 128, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.66/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.66/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.66/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.66.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.66/conv/Conv [Conv] inputs: [/model.66/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.66/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 128, 3, 3)[FLOAT]], [model.66.conv.bias -> (256)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.66/conv/Conv for ONNX node: /model.66/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.66/conv/Conv_output_0 for ONNX tensor: /model.66/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.66/conv/Conv [Conv] outputs: [/model.66/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.66/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.66/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.66/act/LeakyRelu [LeakyRelu] inputs: [/model.66/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.66/act/LeakyRelu for ONNX node: /model.66/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.66/act/LeakyRelu_output_0 for ONNX tensor: /model.66/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.66/act/LeakyRelu [LeakyRelu] outputs: [/model.66/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.67/Concat [Concat] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.66/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.37/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.67/Concat [Concat] inputs: [/model.66/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.37/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.67/Concat for ONNX node: /model.67/Concat [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.67/Concat_output_0 for ONNX tensor: /model.67/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.67/Concat [Concat] outputs: [/model.67/Concat_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.68/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.68/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.68/conv/_input_quantizer/Constant [Constant] outputs: [/model.68/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.68/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.68/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.68/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.68/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.68/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.67/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.68/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.68/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.68/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.67/Concat_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.68/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.68/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.68/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.68/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.68/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.68/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.68/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.68/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.68/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.68/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.68/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.68/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.68/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.68/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.68/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.68/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.68/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.68/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.68/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.68/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.68/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.68/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.68/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.68/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.68/conv/_weight_quantizer/Constant [Constant] outputs: [/model.68/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.68/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.68/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.68/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.68/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.68/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.68.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.68/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.68/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.68/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.68.conv.weight -> (128, 512, 1, 1)[FLOAT]], [/model.68/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.68/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.68.conv.weight for ONNX node: model.68.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.68/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.68/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.68/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.68/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.68/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.68/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.68/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.68/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 512, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.68/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.68/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.68/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.68/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.68/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.68/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 512, 1, 1)[FLOAT]], [/model.68/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.68/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.68/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.68/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.68/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.68/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 512, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.68/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.68/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.68/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.68.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.68/conv/Conv [Conv] inputs: [/model.68/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.68/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 512, 1, 1)[FLOAT]], [model.68.conv.bias -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.68/conv/Conv for ONNX node: /model.68/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.68/conv/Conv_output_0 for ONNX tensor: /model.68/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.68/conv/Conv [Conv] outputs: [/model.68/conv/Conv_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.68/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.68/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.68/act/LeakyRelu [LeakyRelu] inputs: [/model.68/conv/Conv_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.68/act/LeakyRelu for ONNX node: /model.68/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.68/act/LeakyRelu_output_0 for ONNX tensor: /model.68/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.68/act/LeakyRelu [LeakyRelu] outputs: [/model.68/act/LeakyRelu_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.69/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.69/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.69/conv/_input_quantizer/Constant [Constant] outputs: [/model.69/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.69/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.69/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.69/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.69/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.69/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.67/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.69/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.69/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.69/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.67/Concat_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.69/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.69/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.69/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.69/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.69/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.69/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.69/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.69/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.69/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.69/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.69/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.69/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.69/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.69/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.69/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.69/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.69/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.69/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.69/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.69/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.69/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.69/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.69/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.69/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.69/conv/_weight_quantizer/Constant [Constant] outputs: [/model.69/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.69/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.69/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.69/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.69/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.69/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.69.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.69/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.69/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.69/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.69.conv.weight -> (128, 512, 1, 1)[FLOAT]], [/model.69/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.69/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.69.conv.weight for ONNX node: model.69.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.69/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.69/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.69/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.69/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.69/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.69/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.69/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.69/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 512, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.69/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.69/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.69/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.69/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.69/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.69/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 512, 1, 1)[FLOAT]], [/model.69/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.69/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.69/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.69/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.69/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.69/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 512, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.69/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.69/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.69/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.69.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.69/conv/Conv [Conv] inputs: [/model.69/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.69/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 512, 1, 1)[FLOAT]], [model.69.conv.bias -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.69/conv/Conv for ONNX node: /model.69/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.69/conv/Conv_output_0 for ONNX tensor: /model.69/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.69/conv/Conv [Conv] outputs: [/model.69/conv/Conv_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.69/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.69/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.69/act/LeakyRelu [LeakyRelu] inputs: [/model.69/conv/Conv_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.69/act/LeakyRelu for ONNX node: /model.69/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.69/act/LeakyRelu_output_0 for ONNX tensor: /model.69/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.69/act/LeakyRelu [LeakyRelu] outputs: [/model.69/act/LeakyRelu_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.70/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.70/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.70/conv/_input_quantizer/Constant [Constant] outputs: [/model.70/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.70/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.70/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.70/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.70/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.70/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.69/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.70/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.70/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.70/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.69/act/LeakyRelu_output_0 -> (1, 128, 20, 20)[FLOAT]], [/model.70/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.70/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.70/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.70/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.70/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.70/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.70/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.70/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.70/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.70/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.70/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.70/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.70/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.70/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.70/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.70/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 20, 20)[FLOAT]], [/model.70/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.70/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.70/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.70/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.70/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.70/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.70/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.70/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.70/conv/_weight_quantizer/Constant [Constant] outputs: [/model.70/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.70/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.70/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.70/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.70/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.70/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.70.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.70/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.70/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.70/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.70.conv.weight -> (128, 128, 3, 3)[FLOAT]], [/model.70/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.70/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.70.conv.weight for ONNX node: model.70.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.70/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.70/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.70/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.70/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.70/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.70/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.70/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.70/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.70/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.70/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.70/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.70/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.70/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.70/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [/model.70/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.70/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.70/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.70/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.70/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.70/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.70/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.70/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.70/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.70.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.70/conv/Conv [Conv] inputs: [/model.70/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 20, 20)[FLOAT]], [/model.70/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [model.70.conv.bias -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.70/conv/Conv for ONNX node: /model.70/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.70/conv/Conv_output_0 for ONNX tensor: /model.70/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.70/conv/Conv [Conv] outputs: [/model.70/conv/Conv_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.70/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.70/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.70/act/LeakyRelu [LeakyRelu] inputs: [/model.70/conv/Conv_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.70/act/LeakyRelu for ONNX node: /model.70/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.70/act/LeakyRelu_output_0 for ONNX tensor: /model.70/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.70/act/LeakyRelu [LeakyRelu] outputs: [/model.70/act/LeakyRelu_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.71/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.71/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.71/conv/_input_quantizer/Constant [Constant] outputs: [/model.71/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.71/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.71/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.71/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.71/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.71/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.70/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.71/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.71/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.71/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.70/act/LeakyRelu_output_0 -> (1, 128, 20, 20)[FLOAT]], [/model.71/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.71/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.71/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.71/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.71/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.71/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.71/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.71/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.71/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.71/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.71/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.71/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.71/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.71/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.71/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.71/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 20, 20)[FLOAT]], [/model.71/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.71/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.71/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.71/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.71/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.71/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.71/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.71/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.71/conv/_weight_quantizer/Constant [Constant] outputs: [/model.71/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.71/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.71/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.71/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.71/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.71/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.71.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.71/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.71/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.71/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.71.conv.weight -> (128, 128, 3, 3)[FLOAT]], [/model.71/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.71/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.71.conv.weight for ONNX node: model.71.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.71/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.71/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.71/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.71/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.71/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.71/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.71/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.71/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.71/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.71/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.71/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.71/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.71/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.71/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [/model.71/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.71/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.71/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.71/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.71/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.71/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.71/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.71/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.71/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.71.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.71/conv/Conv [Conv] inputs: [/model.71/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 20, 20)[FLOAT]], [/model.71/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [model.71.conv.bias -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.71/conv/Conv for ONNX node: /model.71/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.71/conv/Conv_output_0 for ONNX tensor: /model.71/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.71/conv/Conv [Conv] outputs: [/model.71/conv/Conv_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.71/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.71/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.71/act/LeakyRelu [LeakyRelu] inputs: [/model.71/conv/Conv_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.71/act/LeakyRelu for ONNX node: /model.71/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.71/act/LeakyRelu_output_0 for ONNX tensor: /model.71/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.71/act/LeakyRelu [LeakyRelu] outputs: [/model.71/act/LeakyRelu_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.72/Concat [Concat] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.71/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.70/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.69/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.68/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.72/Concat [Concat] inputs: [/model.71/act/LeakyRelu_output_0 -> (1, 128, 20, 20)[FLOAT]], [/model.70/act/LeakyRelu_output_0 -> (1, 128, 20, 20)[FLOAT]], [/model.69/act/LeakyRelu_output_0 -> (1, 128, 20, 20)[FLOAT]], [/model.68/act/LeakyRelu_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.72/Concat for ONNX node: /model.72/Concat [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.72/Concat_output_0 for ONNX tensor: /model.72/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.72/Concat [Concat] outputs: [/model.72/Concat_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.73/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.73/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.73/conv/_input_quantizer/Constant [Constant] outputs: [/model.73/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.73/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.73/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.73/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.73/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.73/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.72/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.73/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.73/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.73/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.72/Concat_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.73/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.73/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.73/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.73/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.73/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.73/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.73/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.73/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.73/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.73/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.73/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.73/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.73/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.73/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.73/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.73/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.73/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.73/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.73/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.73/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.73/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.73/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.73/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.73/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.73/conv/_weight_quantizer/Constant [Constant] outputs: [/model.73/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.73/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.73/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.73/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.73/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.73/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.73.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.73/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.73/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.73/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.73.conv.weight -> (256, 512, 1, 1)[FLOAT]], [/model.73/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.73/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.73.conv.weight for ONNX node: model.73.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.73/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.73/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.73/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.73/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.73/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.73/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.73/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.73/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.73/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.73/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.73/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.73/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.73/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.73/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [/model.73/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.73/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.73/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.73/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.73/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.73/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.73/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.73/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.73/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.73.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.73/conv/Conv [Conv] inputs: [/model.73/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.73/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [model.73.conv.bias -> (256)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.73/conv/Conv for ONNX node: /model.73/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.73/conv/Conv_output_0 for ONNX tensor: /model.73/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.73/conv/Conv [Conv] outputs: [/model.73/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.73/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.73/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.73/act/LeakyRelu [LeakyRelu] inputs: [/model.73/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.73/act/LeakyRelu for ONNX node: /model.73/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.73/act/LeakyRelu_output_0 for ONNX tensor: /model.73/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.73/act/LeakyRelu [LeakyRelu] outputs: [/model.73/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.74/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.74/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.74/conv/_input_quantizer/Constant [Constant] outputs: [/model.74/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.74/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.74/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.74/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.74/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.74/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.57/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.74/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.74/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.74/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.57/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.74/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.74/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.74/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.74/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.74/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.74/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.74/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.74/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.74/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.74/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.74/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.74/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.74/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.74/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.74/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.74/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.74/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.74/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.74/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.74/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.74/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.74/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.74/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.74/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.74/conv/_weight_quantizer/Constant [Constant] outputs: [/model.74/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.74/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.74/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.74/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.74/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.74/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.74.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.74/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.74/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.74/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.74.conv.weight -> (128, 64, 3, 3)[FLOAT]], [/model.74/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.74/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.74.conv.weight for ONNX node: model.74.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.74/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.74/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.74/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.74/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.74/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.74/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.74/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.74/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 64, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.74/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.74/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.74/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.74/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.74/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.74/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 64, 3, 3)[FLOAT]], [/model.74/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.74/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.74/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.74/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.74/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.74/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 64, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.74/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.74/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.74/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.74.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.74/conv/Conv [Conv] inputs: [/model.74/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.74/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 64, 3, 3)[FLOAT]], [model.74.conv.bias -> (128)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.74/conv/Conv for ONNX node: /model.74/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.74/conv/Conv_output_0 for ONNX tensor: /model.74/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.74/conv/Conv [Conv] outputs: [/model.74/conv/Conv_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.74/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.74/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.74/act/LeakyRelu [LeakyRelu] inputs: [/model.74/conv/Conv_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.74/act/LeakyRelu for ONNX node: /model.74/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.74/act/LeakyRelu_output_0 for ONNX tensor: /model.74/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.74/act/LeakyRelu [LeakyRelu] outputs: [/model.74/act/LeakyRelu_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.75/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.75/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.75/conv/_input_quantizer/Constant [Constant] outputs: [/model.75/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.75/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.75/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.75/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.75/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.75/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.65/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.75/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.75/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.75/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.65/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.75/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.75/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.75/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.75/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.75/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.75/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.75/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.75/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.75/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.75/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.75/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.75/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.75/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.75/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.75/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.75/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.75/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.75/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.75/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.75/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.75/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.75/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.75/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.75/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.75/conv/_weight_quantizer/Constant [Constant] outputs: [/model.75/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.75/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.75/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.75/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.75/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.75/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.75.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.75/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.75/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.75/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.75.conv.weight -> (256, 128, 3, 3)[FLOAT]], [/model.75/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.75/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.75.conv.weight for ONNX node: model.75.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.75/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.75/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.75/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.75/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.75/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.75/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.75/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.75/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 128, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.75/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.75/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.75/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.75/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.75/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.75/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 128, 3, 3)[FLOAT]], [/model.75/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.75/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.75/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.75/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.75/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.75/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 128, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.75/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.75/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.75/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.75.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.75/conv/Conv [Conv] inputs: [/model.75/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.75/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 128, 3, 3)[FLOAT]], [model.75.conv.bias -> (256)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.75/conv/Conv for ONNX node: /model.75/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.75/conv/Conv_output_0 for ONNX tensor: /model.75/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.75/conv/Conv [Conv] outputs: [/model.75/conv/Conv_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.75/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.75/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.75/act/LeakyRelu [LeakyRelu] inputs: [/model.75/conv/Conv_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.75/act/LeakyRelu for ONNX node: /model.75/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.75/act/LeakyRelu_output_0 for ONNX tensor: /model.75/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.75/act/LeakyRelu [LeakyRelu] outputs: [/model.75/act/LeakyRelu_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.76/conv/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.76/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.76/conv/_input_quantizer/Constant [Constant] outputs: [/model.76/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.76/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.76/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.76/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.76/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.76/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.73/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.76/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.76/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.76/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.73/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.76/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.76/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.76/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.76/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.76/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.76/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.76/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.76/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.76/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.76/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.76/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.76/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.76/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.76/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.76/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.76/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.76/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.76/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.76/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.76/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.76/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.76/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.76/conv/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.76/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.76/conv/_weight_quantizer/Constant [Constant] outputs: [/model.76/conv/_weight_quantizer/Constant_output_0 -> (512)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.76/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.76/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.76/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.76/conv/_weight_quantizer/Constant_1_output_0 -> (512)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.76/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.76.conv.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.76/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.76/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.76/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.76.conv.weight -> (512, 256, 3, 3)[FLOAT]], [/model.76/conv/_weight_quantizer/Constant_output_0 -> (512)[FLOAT]], [/model.76/conv/_weight_quantizer/Constant_1_output_0 -> (512)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.76.conv.weight for ONNX node: model.76.conv.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.76/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.76/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.76/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.76/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.76/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.76/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.76/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.76/conv/_weight_quantizer/QuantizeLinear_output_0 -> (512, 256, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.76/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.76/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.76/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.76/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.76/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.76/conv/_weight_quantizer/QuantizeLinear_output_0 -> (512, 256, 3, 3)[FLOAT]], [/model.76/conv/_weight_quantizer/Constant_output_0 -> (512)[FLOAT]], [/model.76/conv/_weight_quantizer/Constant_1_output_0 -> (512)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.76/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.76/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.76/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.76/conv/_weight_quantizer/DequantizeLinear_output_0 -> (512, 256, 3, 3)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.76/conv/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.76/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.76/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.76.conv.bias [04/18/2023-13:39:19] [V] [TRT] /model.76/conv/Conv [Conv] inputs: [/model.76/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.76/conv/_weight_quantizer/DequantizeLinear_output_0 -> (512, 256, 3, 3)[FLOAT]], [model.76.conv.bias -> (512)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.76/conv/Conv for ONNX node: /model.76/conv/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.76/conv/Conv_output_0 for ONNX tensor: /model.76/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.76/conv/Conv [Conv] outputs: [/model.76/conv/Conv_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.76/act/LeakyRelu [LeakyRelu] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.76/conv/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.76/act/LeakyRelu [LeakyRelu] inputs: [/model.76/conv/Conv_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.76/act/LeakyRelu for ONNX node: /model.76/act/LeakyRelu [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.76/act/LeakyRelu_output_0 for ONNX tensor: /model.76/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.76/act/LeakyRelu [LeakyRelu] outputs: [/model.76/act/LeakyRelu_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.0/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/m.0/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/m.0/_input_quantizer/Constant [Constant] outputs: [/model.77/m.0/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.0/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/m.0/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/m.0/_input_quantizer/Constant_1 [Constant] outputs: [/model.77/m.0/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.0/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.74/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.0/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.0/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.0/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.74/act/LeakyRelu_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.77/m.0/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.77/m.0/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/m.0/_input_quantizer/Constant_1_output_0 for ONNX node: /model.77/m.0/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/m.0/_input_quantizer/Constant_output_0 for ONNX node: /model.77/m.0/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/m.0/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.77/m.0/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.0/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.77/m.0/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.0/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.0/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.0/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.0/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.0/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.77/m.0/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.77/m.0/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.77/m.0/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/m.0/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.77/m.0/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.0/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.77/m.0/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.0/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/m.0/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/m.0/_weight_quantizer/Constant [Constant] outputs: [/model.77/m.0/_weight_quantizer/Constant_output_0 -> (255)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.0/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/m.0/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/m.0/_weight_quantizer/Constant_1 [Constant] outputs: [/model.77/m.0/_weight_quantizer/Constant_1_output_0 -> (255)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.0/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.77.m.0.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.0/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.0/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.0/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.77.m.0.weight -> (255, 128, 1, 1)[FLOAT]], [/model.77/m.0/_weight_quantizer/Constant_output_0 -> (255)[FLOAT]], [/model.77/m.0/_weight_quantizer/Constant_1_output_0 -> (255)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.77.m.0.weight for ONNX node: model.77.m.0.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/m.0/_weight_quantizer/Constant_output_0 for ONNX node: /model.77/m.0/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/m.0/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.77/m.0/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/m.0/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.77/m.0/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.0/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.77/m.0/_weight_quantizer/QuantizeLinear_output_0 -> (255, 128, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.0/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.0/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.0/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.0/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.0/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.77/m.0/_weight_quantizer/QuantizeLinear_output_0 -> (255, 128, 1, 1)[FLOAT]], [/model.77/m.0/_weight_quantizer/Constant_output_0 -> (255)[FLOAT]], [/model.77/m.0/_weight_quantizer/Constant_1_output_0 -> (255)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/m.0/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.77/m.0/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.0/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.77/m.0/_weight_quantizer/DequantizeLinear_output_0 -> (255, 128, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.0/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.0/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.0/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.77.m.0.bias [04/18/2023-13:39:19] [V] [TRT] /model.77/m.0/Conv [Conv] inputs: [/model.77/m.0/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.77/m.0/_weight_quantizer/DequantizeLinear_output_0 -> (255, 128, 1, 1)[FLOAT]], [model.77.m.0.bias -> (255)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/m.0/Conv for ONNX node: /model.77/m.0/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/m.0/Conv_output_0 for ONNX tensor: /model.77/m.0/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.0/Conv [Conv] outputs: [/model.77/m.0/Conv_output_0 -> (1, 255, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant [Constant] outputs: [/model.77/Constant_output_0 -> (5)[INT32]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Reshape [Reshape] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.0/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Reshape [Reshape] inputs: [/model.77/m.0/Conv_output_0 -> (1, 255, 80, 80)[FLOAT]], [/model.77/Constant_output_0 -> (5)[INT32]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Reshape for ONNX node: /model.77/Reshape [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Reshape_output_0 for ONNX tensor: /model.77/Reshape_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Reshape [Reshape] outputs: [/model.77/Reshape_output_0 -> (1, 3, 85, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Transpose [Transpose] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Reshape_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Transpose [Transpose] inputs: [/model.77/Reshape_output_0 -> (1, 3, 85, 80, 80)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Transpose for ONNX node: /model.77/Transpose [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Transpose_output_0 for ONNX tensor: /model.77/Transpose_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Transpose [Transpose] outputs: [/model.77/Transpose_output_0 -> (1, 3, 80, 80, 85)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Sigmoid [Sigmoid] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Transpose_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Sigmoid [Sigmoid] inputs: [/model.77/Transpose_output_0 -> (1, 3, 80, 80, 85)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Sigmoid for ONNX node: /model.77/Sigmoid [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Sigmoid_output_0 for ONNX tensor: /model.77/Sigmoid_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Sigmoid [Sigmoid] outputs: [/model.77/Sigmoid_output_0 -> (1, 3, 80, 80, 85)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: Constant_575 [Constant] [04/18/2023-13:39:19] [V] [TRT] Constant_575 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] Constant_575 [Constant] outputs: [onnx::Split_855 -> (3)[INT32]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Split [Split] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Sigmoid_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: onnx::Split_855 [04/18/2023-13:39:19] [V] [TRT] /model.77/Split [Split] inputs: [/model.77/Sigmoid_output_0 -> (1, 3, 80, 80, 85)[FLOAT]], [onnx::Split_855 -> (3)[INT32]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Split for ONNX node: /model.77/Split [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Split_110 for ONNX node: /model.77/Split [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Split_111 for ONNX node: /model.77/Split [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Split_output_0 for ONNX tensor: /model.77/Split_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Split_output_1 for ONNX tensor: /model.77/Split_output_1 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Split_output_2 for ONNX tensor: /model.77/Split_output_2 [04/18/2023-13:39:19] [V] [TRT] /model.77/Split [Split] outputs: [/model.77/Split_output_0 -> (1, 3, 80, 80, 2)[FLOAT]], [/model.77/Split_output_1 -> (1, 3, 80, 80, 2)[FLOAT]], [/model.77/Split_output_2 -> (1, 3, 80, 80, 81)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_1 [Constant] outputs: [/model.77/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Mul [Mul] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Split_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Mul [Mul] inputs: [/model.77/Split_output_0 -> (1, 3, 80, 80, 2)[FLOAT]], [/model.77/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Constant_1_output_0 for ONNX node: /model.77/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Mul for ONNX node: /model.77/Mul [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Mul_output_0 for ONNX tensor: /model.77/Mul_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Mul [Mul] outputs: [/model.77/Mul_output_0 -> (1, 3, 80, 80, 2)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Constant_2 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_2 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_2 [Constant] outputs: [/model.77/Constant_2_output_0 -> (1, 1, 80, 80, 2)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Add [Add] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Mul_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Constant_2_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Add [Add] inputs: [/model.77/Mul_output_0 -> (1, 3, 80, 80, 2)[FLOAT]], [/model.77/Constant_2_output_0 -> (1, 1, 80, 80, 2)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Constant_2_output_0 for ONNX node: /model.77/Constant_2_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Add for ONNX node: /model.77/Add [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Add_output_0 for ONNX tensor: /model.77/Add_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Add [Add] outputs: [/model.77/Add_output_0 -> (1, 3, 80, 80, 2)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Constant_3 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_3 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_3 [Constant] outputs: [/model.77/Constant_3_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Pow [Pow] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Split_output_1 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Constant_3_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Pow [Pow] inputs: [/model.77/Split_output_1 -> (1, 3, 80, 80, 2)[FLOAT]], [/model.77/Constant_3_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Constant_3_output_0 for ONNX node: /model.77/Constant_3_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Pow for ONNX node: /model.77/Pow [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Pow_output_0 for ONNX tensor: /model.77/Pow_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Pow [Pow] outputs: [/model.77/Pow_output_0 -> (1, 3, 80, 80, 2)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Constant_4 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_4 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_4 [Constant] outputs: [/model.77/Constant_4_output_0 -> (1, 3, 1, 1, 2)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Mul_1 [Mul] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Pow_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Constant_4_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Mul_1 [Mul] inputs: [/model.77/Pow_output_0 -> (1, 3, 80, 80, 2)[FLOAT]], [/model.77/Constant_4_output_0 -> (1, 3, 1, 1, 2)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Constant_4_output_0 for ONNX node: /model.77/Constant_4_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Mul_1 for ONNX node: /model.77/Mul_1 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Mul_1_output_0 for ONNX tensor: /model.77/Mul_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Mul_1 [Mul] outputs: [/model.77/Mul_1_output_0 -> (1, 3, 80, 80, 2)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Concat [Concat] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Add_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Mul_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Split_output_2 [04/18/2023-13:39:19] [V] [TRT] /model.77/Concat [Concat] inputs: [/model.77/Add_output_0 -> (1, 3, 80, 80, 2)[FLOAT]], [/model.77/Mul_1_output_0 -> (1, 3, 80, 80, 2)[FLOAT]], [/model.77/Split_output_2 -> (1, 3, 80, 80, 81)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Concat for ONNX node: /model.77/Concat [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Concat_output_0 for ONNX tensor: /model.77/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Concat [Concat] outputs: [/model.77/Concat_output_0 -> (1, 3, 80, 80, 85)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Constant_5 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_5 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_5 [Constant] outputs: [/model.77/Constant_5_output_0 -> (3)[INT32]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Reshape_1 [Reshape] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Concat_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Constant_5_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Reshape_1 [Reshape] inputs: [/model.77/Concat_output_0 -> (1, 3, 80, 80, 85)[FLOAT]], [/model.77/Constant_5_output_0 -> (3)[INT32]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Reshape_1 for ONNX node: /model.77/Reshape_1 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Reshape_1_output_0 for ONNX tensor: /model.77/Reshape_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Reshape_1 [Reshape] outputs: [/model.77/Reshape_1_output_0 -> (1, 19200, 85)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.1/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/m.1/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/m.1/_input_quantizer/Constant [Constant] outputs: [/model.77/m.1/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.1/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/m.1/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/m.1/_input_quantizer/Constant_1 [Constant] outputs: [/model.77/m.1/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.1/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.75/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.1/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.1/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.1/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.75/act/LeakyRelu_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.77/m.1/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.77/m.1/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/m.1/_input_quantizer/Constant_1_output_0 for ONNX node: /model.77/m.1/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/m.1/_input_quantizer/Constant_output_0 for ONNX node: /model.77/m.1/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/m.1/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.77/m.1/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.1/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.77/m.1/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.1/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.1/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.1/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.1/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.1/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.77/m.1/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.77/m.1/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.77/m.1/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/m.1/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.77/m.1/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.1/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.77/m.1/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.1/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/m.1/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/m.1/_weight_quantizer/Constant [Constant] outputs: [/model.77/m.1/_weight_quantizer/Constant_output_0 -> (255)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.1/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/m.1/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/m.1/_weight_quantizer/Constant_1 [Constant] outputs: [/model.77/m.1/_weight_quantizer/Constant_1_output_0 -> (255)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.1/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.77.m.1.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.1/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.1/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.1/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.77.m.1.weight -> (255, 256, 1, 1)[FLOAT]], [/model.77/m.1/_weight_quantizer/Constant_output_0 -> (255)[FLOAT]], [/model.77/m.1/_weight_quantizer/Constant_1_output_0 -> (255)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.77.m.1.weight for ONNX node: model.77.m.1.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/m.1/_weight_quantizer/Constant_output_0 for ONNX node: /model.77/m.1/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/m.1/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.77/m.1/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/m.1/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.77/m.1/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.1/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.77/m.1/_weight_quantizer/QuantizeLinear_output_0 -> (255, 256, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.1/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.1/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.1/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.1/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.1/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.77/m.1/_weight_quantizer/QuantizeLinear_output_0 -> (255, 256, 1, 1)[FLOAT]], [/model.77/m.1/_weight_quantizer/Constant_output_0 -> (255)[FLOAT]], [/model.77/m.1/_weight_quantizer/Constant_1_output_0 -> (255)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/m.1/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.77/m.1/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.1/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.77/m.1/_weight_quantizer/DequantizeLinear_output_0 -> (255, 256, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.1/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.1/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.1/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.77.m.1.bias [04/18/2023-13:39:19] [V] [TRT] /model.77/m.1/Conv [Conv] inputs: [/model.77/m.1/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.77/m.1/_weight_quantizer/DequantizeLinear_output_0 -> (255, 256, 1, 1)[FLOAT]], [model.77.m.1.bias -> (255)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/m.1/Conv for ONNX node: /model.77/m.1/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/m.1/Conv_output_0 for ONNX tensor: /model.77/m.1/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.1/Conv [Conv] outputs: [/model.77/m.1/Conv_output_0 -> (1, 255, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Constant_6 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_6 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_6 [Constant] outputs: [/model.77/Constant_6_output_0 -> (5)[INT32]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Reshape_2 [Reshape] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.1/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Constant_6_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Reshape_2 [Reshape] inputs: [/model.77/m.1/Conv_output_0 -> (1, 255, 40, 40)[FLOAT]], [/model.77/Constant_6_output_0 -> (5)[INT32]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Reshape_2 for ONNX node: /model.77/Reshape_2 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Reshape_2_output_0 for ONNX tensor: /model.77/Reshape_2_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Reshape_2 [Reshape] outputs: [/model.77/Reshape_2_output_0 -> (1, 3, 85, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Transpose_1 [Transpose] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Reshape_2_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Transpose_1 [Transpose] inputs: [/model.77/Reshape_2_output_0 -> (1, 3, 85, 40, 40)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Transpose_1 for ONNX node: /model.77/Transpose_1 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Transpose_1_output_0 for ONNX tensor: /model.77/Transpose_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Transpose_1 [Transpose] outputs: [/model.77/Transpose_1_output_0 -> (1, 3, 40, 40, 85)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Sigmoid_1 [Sigmoid] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Transpose_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Sigmoid_1 [Sigmoid] inputs: [/model.77/Transpose_1_output_0 -> (1, 3, 40, 40, 85)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Sigmoid_1 for ONNX node: /model.77/Sigmoid_1 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Sigmoid_1_output_0 for ONNX tensor: /model.77/Sigmoid_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Sigmoid_1 [Sigmoid] outputs: [/model.77/Sigmoid_1_output_0 -> (1, 3, 40, 40, 85)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Split_1 [Split] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Sigmoid_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: onnx::Split_855 [04/18/2023-13:39:19] [V] [TRT] /model.77/Split_1 [Split] inputs: [/model.77/Sigmoid_1_output_0 -> (1, 3, 40, 40, 85)[FLOAT]], [onnx::Split_855 -> (3)[INT32]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Split_1 for ONNX node: /model.77/Split_1 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Split_1_116 for ONNX node: /model.77/Split_1 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Split_1_117 for ONNX node: /model.77/Split_1 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Split_1_output_0 for ONNX tensor: /model.77/Split_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Split_1_output_1 for ONNX tensor: /model.77/Split_1_output_1 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Split_1_output_2 for ONNX tensor: /model.77/Split_1_output_2 [04/18/2023-13:39:19] [V] [TRT] /model.77/Split_1 [Split] outputs: [/model.77/Split_1_output_0 -> (1, 3, 40, 40, 2)[FLOAT]], [/model.77/Split_1_output_1 -> (1, 3, 40, 40, 2)[FLOAT]], [/model.77/Split_1_output_2 -> (1, 3, 40, 40, 81)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Constant_7 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_7 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_7 [Constant] outputs: [/model.77/Constant_7_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Mul_2 [Mul] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Split_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Constant_7_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Mul_2 [Mul] inputs: [/model.77/Split_1_output_0 -> (1, 3, 40, 40, 2)[FLOAT]], [/model.77/Constant_7_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Constant_7_output_0 for ONNX node: /model.77/Constant_7_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Mul_2 for ONNX node: /model.77/Mul_2 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Mul_2_output_0 for ONNX tensor: /model.77/Mul_2_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Mul_2 [Mul] outputs: [/model.77/Mul_2_output_0 -> (1, 3, 40, 40, 2)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Constant_8 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_8 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_8 [Constant] outputs: [/model.77/Constant_8_output_0 -> (1, 1, 40, 40, 2)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Add_1 [Add] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Mul_2_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Constant_8_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Add_1 [Add] inputs: [/model.77/Mul_2_output_0 -> (1, 3, 40, 40, 2)[FLOAT]], [/model.77/Constant_8_output_0 -> (1, 1, 40, 40, 2)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Constant_8_output_0 for ONNX node: /model.77/Constant_8_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Add_1 for ONNX node: /model.77/Add_1 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Add_1_output_0 for ONNX tensor: /model.77/Add_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Add_1 [Add] outputs: [/model.77/Add_1_output_0 -> (1, 3, 40, 40, 2)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Constant_9 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_9 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_9 [Constant] outputs: [/model.77/Constant_9_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Pow_1 [Pow] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Split_1_output_1 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Constant_9_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Pow_1 [Pow] inputs: [/model.77/Split_1_output_1 -> (1, 3, 40, 40, 2)[FLOAT]], [/model.77/Constant_9_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Constant_9_output_0 for ONNX node: /model.77/Constant_9_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Pow_1 for ONNX node: /model.77/Pow_1 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Pow_1_output_0 for ONNX tensor: /model.77/Pow_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Pow_1 [Pow] outputs: [/model.77/Pow_1_output_0 -> (1, 3, 40, 40, 2)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Constant_10 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_10 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_10 [Constant] outputs: [/model.77/Constant_10_output_0 -> (1, 3, 1, 1, 2)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Mul_3 [Mul] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Pow_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Constant_10_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Mul_3 [Mul] inputs: [/model.77/Pow_1_output_0 -> (1, 3, 40, 40, 2)[FLOAT]], [/model.77/Constant_10_output_0 -> (1, 3, 1, 1, 2)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Constant_10_output_0 for ONNX node: /model.77/Constant_10_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Mul_3 for ONNX node: /model.77/Mul_3 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Mul_3_output_0 for ONNX tensor: /model.77/Mul_3_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Mul_3 [Mul] outputs: [/model.77/Mul_3_output_0 -> (1, 3, 40, 40, 2)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Concat_1 [Concat] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Add_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Mul_3_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Split_1_output_2 [04/18/2023-13:39:19] [V] [TRT] /model.77/Concat_1 [Concat] inputs: [/model.77/Add_1_output_0 -> (1, 3, 40, 40, 2)[FLOAT]], [/model.77/Mul_3_output_0 -> (1, 3, 40, 40, 2)[FLOAT]], [/model.77/Split_1_output_2 -> (1, 3, 40, 40, 81)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Concat_1 for ONNX node: /model.77/Concat_1 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Concat_1_output_0 for ONNX tensor: /model.77/Concat_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Concat_1 [Concat] outputs: [/model.77/Concat_1_output_0 -> (1, 3, 40, 40, 85)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Constant_11 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_11 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_11 [Constant] outputs: [/model.77/Constant_11_output_0 -> (3)[INT32]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Reshape_3 [Reshape] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Concat_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Constant_11_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Reshape_3 [Reshape] inputs: [/model.77/Concat_1_output_0 -> (1, 3, 40, 40, 85)[FLOAT]], [/model.77/Constant_11_output_0 -> (3)[INT32]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Reshape_3 for ONNX node: /model.77/Reshape_3 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Reshape_3_output_0 for ONNX tensor: /model.77/Reshape_3_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Reshape_3 [Reshape] outputs: [/model.77/Reshape_3_output_0 -> (1, 4800, 85)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.2/_input_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/m.2/_input_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/m.2/_input_quantizer/Constant [Constant] outputs: [/model.77/m.2/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.2/_input_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/m.2/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/m.2/_input_quantizer/Constant_1 [Constant] outputs: [/model.77/m.2/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.2/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.76/act/LeakyRelu_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.2/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.2/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.2/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.76/act/LeakyRelu_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.77/m.2/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.77/m.2/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/m.2/_input_quantizer/Constant_1_output_0 for ONNX node: /model.77/m.2/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/m.2/_input_quantizer/Constant_output_0 for ONNX node: /model.77/m.2/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/m.2/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.77/m.2/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.2/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.77/m.2/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.2/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.2/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.2/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.2/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.2/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.77/m.2/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.77/m.2/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.77/m.2/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/m.2/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.77/m.2/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.2/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.77/m.2/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.2/_weight_quantizer/Constant [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/m.2/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/m.2/_weight_quantizer/Constant [Constant] outputs: [/model.77/m.2/_weight_quantizer/Constant_output_0 -> (255)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.2/_weight_quantizer/Constant_1 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/m.2/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/m.2/_weight_quantizer/Constant_1 [Constant] outputs: [/model.77/m.2/_weight_quantizer/Constant_1_output_0 -> (255)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.2/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.77.m.2.weight [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.2/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.2/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.2/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.77.m.2.weight -> (255, 512, 1, 1)[FLOAT]], [/model.77/m.2/_weight_quantizer/Constant_output_0 -> (255)[FLOAT]], [/model.77/m.2/_weight_quantizer/Constant_1_output_0 -> (255)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: model.77.m.2.weight for ONNX node: model.77.m.2.weight [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/m.2/_weight_quantizer/Constant_output_0 for ONNX node: /model.77/m.2/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/m.2/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.77/m.2/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/m.2/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.77/m.2/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.2/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.77/m.2/_weight_quantizer/QuantizeLinear_output_0 -> (255, 512, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.2/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.2/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.2/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.2/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.2/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.77/m.2/_weight_quantizer/QuantizeLinear_output_0 -> (255, 512, 1, 1)[FLOAT]], [/model.77/m.2/_weight_quantizer/Constant_output_0 -> (255)[FLOAT]], [/model.77/m.2/_weight_quantizer/Constant_1_output_0 -> (255)[INT8]], [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/m.2/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.77/m.2/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.2/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.77/m.2/_weight_quantizer/DequantizeLinear_output_0 -> (255, 512, 1, 1)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/m.2/Conv [Conv] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.2/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.2/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: model.77.m.2.bias [04/18/2023-13:39:19] [V] [TRT] /model.77/m.2/Conv [Conv] inputs: [/model.77/m.2/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.77/m.2/_weight_quantizer/DequantizeLinear_output_0 -> (255, 512, 1, 1)[FLOAT]], [model.77.m.2.bias -> (255)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/m.2/Conv for ONNX node: /model.77/m.2/Conv [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/m.2/Conv_output_0 for ONNX tensor: /model.77/m.2/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/m.2/Conv [Conv] outputs: [/model.77/m.2/Conv_output_0 -> (1, 255, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Constant_12 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_12 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_12 [Constant] outputs: [/model.77/Constant_12_output_0 -> (5)[INT32]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Reshape_4 [Reshape] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/m.2/Conv_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Constant_12_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Reshape_4 [Reshape] inputs: [/model.77/m.2/Conv_output_0 -> (1, 255, 20, 20)[FLOAT]], [/model.77/Constant_12_output_0 -> (5)[INT32]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Reshape_4 for ONNX node: /model.77/Reshape_4 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Reshape_4_output_0 for ONNX tensor: /model.77/Reshape_4_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Reshape_4 [Reshape] outputs: [/model.77/Reshape_4_output_0 -> (1, 3, 85, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Transpose_2 [Transpose] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Reshape_4_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Transpose_2 [Transpose] inputs: [/model.77/Reshape_4_output_0 -> (1, 3, 85, 20, 20)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Transpose_2 for ONNX node: /model.77/Transpose_2 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Transpose_2_output_0 for ONNX tensor: /model.77/Transpose_2_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Transpose_2 [Transpose] outputs: [/model.77/Transpose_2_output_0 -> (1, 3, 20, 20, 85)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Sigmoid_2 [Sigmoid] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Transpose_2_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Sigmoid_2 [Sigmoid] inputs: [/model.77/Transpose_2_output_0 -> (1, 3, 20, 20, 85)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Sigmoid_2 for ONNX node: /model.77/Sigmoid_2 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Sigmoid_2_output_0 for ONNX tensor: /model.77/Sigmoid_2_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Sigmoid_2 [Sigmoid] outputs: [/model.77/Sigmoid_2_output_0 -> (1, 3, 20, 20, 85)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Split_2 [Split] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Sigmoid_2_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: onnx::Split_855 [04/18/2023-13:39:19] [V] [TRT] /model.77/Split_2 [Split] inputs: [/model.77/Sigmoid_2_output_0 -> (1, 3, 20, 20, 85)[FLOAT]], [onnx::Split_855 -> (3)[INT32]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Split_2 for ONNX node: /model.77/Split_2 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Split_2_122 for ONNX node: /model.77/Split_2 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Split_2_123 for ONNX node: /model.77/Split_2 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Split_2_output_0 for ONNX tensor: /model.77/Split_2_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Split_2_output_1 for ONNX tensor: /model.77/Split_2_output_1 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Split_2_output_2 for ONNX tensor: /model.77/Split_2_output_2 [04/18/2023-13:39:19] [V] [TRT] /model.77/Split_2 [Split] outputs: [/model.77/Split_2_output_0 -> (1, 3, 20, 20, 2)[FLOAT]], [/model.77/Split_2_output_1 -> (1, 3, 20, 20, 2)[FLOAT]], [/model.77/Split_2_output_2 -> (1, 3, 20, 20, 81)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Constant_13 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_13 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_13 [Constant] outputs: [/model.77/Constant_13_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Mul_4 [Mul] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Split_2_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Constant_13_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Mul_4 [Mul] inputs: [/model.77/Split_2_output_0 -> (1, 3, 20, 20, 2)[FLOAT]], [/model.77/Constant_13_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Constant_13_output_0 for ONNX node: /model.77/Constant_13_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Mul_4 for ONNX node: /model.77/Mul_4 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Mul_4_output_0 for ONNX tensor: /model.77/Mul_4_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Mul_4 [Mul] outputs: [/model.77/Mul_4_output_0 -> (1, 3, 20, 20, 2)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Constant_14 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_14 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_14 [Constant] outputs: [/model.77/Constant_14_output_0 -> (1, 1, 20, 20, 2)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Add_2 [Add] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Mul_4_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Constant_14_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Add_2 [Add] inputs: [/model.77/Mul_4_output_0 -> (1, 3, 20, 20, 2)[FLOAT]], [/model.77/Constant_14_output_0 -> (1, 1, 20, 20, 2)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Constant_14_output_0 for ONNX node: /model.77/Constant_14_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Add_2 for ONNX node: /model.77/Add_2 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Add_2_output_0 for ONNX tensor: /model.77/Add_2_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Add_2 [Add] outputs: [/model.77/Add_2_output_0 -> (1, 3, 20, 20, 2)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Constant_15 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_15 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_15 [Constant] outputs: [/model.77/Constant_15_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Pow_2 [Pow] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Split_2_output_1 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Constant_15_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Pow_2 [Pow] inputs: [/model.77/Split_2_output_1 -> (1, 3, 20, 20, 2)[FLOAT]], [/model.77/Constant_15_output_0 -> ()[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Constant_15_output_0 for ONNX node: /model.77/Constant_15_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Pow_2 for ONNX node: /model.77/Pow_2 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Pow_2_output_0 for ONNX tensor: /model.77/Pow_2_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Pow_2 [Pow] outputs: [/model.77/Pow_2_output_0 -> (1, 3, 20, 20, 2)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Constant_16 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_16 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_16 [Constant] outputs: [/model.77/Constant_16_output_0 -> (1, 3, 1, 1, 2)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Mul_5 [Mul] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Pow_2_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Constant_16_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Mul_5 [Mul] inputs: [/model.77/Pow_2_output_0 -> (1, 3, 20, 20, 2)[FLOAT]], [/model.77/Constant_16_output_0 -> (1, 3, 1, 1, 2)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Constant_16_output_0 for ONNX node: /model.77/Constant_16_output_0 [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Mul_5 for ONNX node: /model.77/Mul_5 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Mul_5_output_0 for ONNX tensor: /model.77/Mul_5_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Mul_5 [Mul] outputs: [/model.77/Mul_5_output_0 -> (1, 3, 20, 20, 2)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Concat_2 [Concat] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Add_2_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Mul_5_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Split_2_output_2 [04/18/2023-13:39:19] [V] [TRT] /model.77/Concat_2 [Concat] inputs: [/model.77/Add_2_output_0 -> (1, 3, 20, 20, 2)[FLOAT]], [/model.77/Mul_5_output_0 -> (1, 3, 20, 20, 2)[FLOAT]], [/model.77/Split_2_output_2 -> (1, 3, 20, 20, 81)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Concat_2 for ONNX node: /model.77/Concat_2 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Concat_2_output_0 for ONNX tensor: /model.77/Concat_2_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Concat_2 [Concat] outputs: [/model.77/Concat_2_output_0 -> (1, 3, 20, 20, 85)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Constant_17 [Constant] [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_17 [Constant] inputs: [04/18/2023-13:39:19] [V] [TRT] /model.77/Constant_17 [Constant] outputs: [/model.77/Constant_17_output_0 -> (3)[INT32]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Reshape_5 [Reshape] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Concat_2_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Constant_17_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Reshape_5 [Reshape] inputs: [/model.77/Concat_2_output_0 -> (1, 3, 20, 20, 85)[FLOAT]], [/model.77/Constant_17_output_0 -> (3)[INT32]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Reshape_5 for ONNX node: /model.77/Reshape_5 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: /model.77/Reshape_5_output_0 for ONNX tensor: /model.77/Reshape_5_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Reshape_5 [Reshape] outputs: [/model.77/Reshape_5_output_0 -> (1, 1200, 85)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Parsing node: /model.77/Concat_3 [Concat] [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Reshape_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Reshape_3_output_0 [04/18/2023-13:39:19] [V] [TRT] Searching for input: /model.77/Reshape_5_output_0 [04/18/2023-13:39:19] [V] [TRT] /model.77/Concat_3 [Concat] inputs: [/model.77/Reshape_1_output_0 -> (1, 19200, 85)[FLOAT]], [/model.77/Reshape_3_output_0 -> (1, 4800, 85)[FLOAT]], [/model.77/Reshape_5_output_0 -> (1, 1200, 85)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Registering layer: /model.77/Concat_3 for ONNX node: /model.77/Concat_3 [04/18/2023-13:39:19] [V] [TRT] Registering tensor: outputs_125 for ONNX tensor: outputs [04/18/2023-13:39:19] [V] [TRT] /model.77/Concat_3 [Concat] outputs: [outputs -> (1, 25200, 85)[FLOAT]], [04/18/2023-13:39:19] [V] [TRT] Marking outputs_125 as output: outputs [04/18/2023-13:39:19] [I] Finish parsing network model [04/18/2023-13:39:19] [V] [TRT] Original: 700 layers [04/18/2023-13:39:19] [V] [TRT] After dead-layer removal: 700 layers [04/18/2023-13:39:19] [V] [TRT] Applying generic optimizations to the graph for inference. [04/18/2023-13:39:19] [V] [TRT] Running: ConstShuffleFusion on /model.77/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] ConstShuffleFusion: Fusing /model.77/Constant_1_output_0 with (Unnamed Layer* 632) [Shuffle] [04/18/2023-13:39:19] [V] [TRT] Running: ConstShuffleFusion on /model.77/Constant_3_output_0 [04/18/2023-13:39:19] [V] [TRT] ConstShuffleFusion: Fusing /model.77/Constant_3_output_0 with (Unnamed Layer* 637) [Shuffle] [04/18/2023-13:39:19] [V] [TRT] Running: ConstShuffleFusion on /model.77/Constant_7_output_0 [04/18/2023-13:39:19] [V] [TRT] ConstShuffleFusion: Fusing /model.77/Constant_7_output_0 with (Unnamed Layer* 660) [Shuffle] [04/18/2023-13:39:19] [V] [TRT] Running: ConstShuffleFusion on /model.77/Constant_9_output_0 [04/18/2023-13:39:19] [V] [TRT] ConstShuffleFusion: Fusing /model.77/Constant_9_output_0 with (Unnamed Layer* 665) [Shuffle] [04/18/2023-13:39:19] [V] [TRT] Running: ShuffleShuffleFusion on /model.77/Reshape [04/18/2023-13:39:19] [V] [TRT] ShuffleShuffleFusion: Fusing /model.77/Reshape with /model.77/Transpose [04/18/2023-13:39:19] [V] [TRT] Running: ShuffleShuffleFusion on /model.77/Reshape_2 [04/18/2023-13:39:19] [V] [TRT] ShuffleShuffleFusion: Fusing /model.77/Reshape_2 with /model.77/Transpose_1 [04/18/2023-13:39:19] [V] [TRT] Running: ShuffleShuffleFusion on /model.77/Reshape_4 [04/18/2023-13:39:19] [V] [TRT] ShuffleShuffleFusion: Fusing /model.77/Reshape_4 with /model.77/Transpose_2 [04/18/2023-13:39:19] [V] [TRT] Running: ConstShuffleFusion on /model.77/Constant_13_output_0 [04/18/2023-13:39:19] [V] [TRT] ConstShuffleFusion: Fusing /model.77/Constant_13_output_0 with (Unnamed Layer* 688) [Shuffle] [04/18/2023-13:39:19] [V] [TRT] Running: ConstShuffleFusion on /model.77/Constant_15_output_0 [04/18/2023-13:39:19] [V] [TRT] ConstShuffleFusion: Fusing /model.77/Constant_15_output_0 with (Unnamed Layer* 693) [Shuffle] [04/18/2023-13:39:19] [V] [TRT] QDQ graph optimizer - constant folding of Q/DQ initializers [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.0/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.0/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.1/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.2/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.3/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.4/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.5/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.7/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.9/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.10/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.11/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.12/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.14/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.16/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.17/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.18/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.19/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.21/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.23/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.24/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.25/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.26/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.28/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.29/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.30/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.35/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.37/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.38/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.40/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.42/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.43/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.44/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.45/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.47/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.48/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.50/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.52/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.53/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.54/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.55/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.57/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.58/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.60/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.61/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.62/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.63/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.65/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.66/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.68/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.69/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.70/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.71/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.73/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.74/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.75/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.76/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.77/m.0/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.77/m.1/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.77/m.2/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.0/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.0/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.0/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.1/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.1/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.1/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.3/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.3/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.3/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.5/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.5/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.5/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.9/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.9/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.9/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.11/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.11/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.11/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.14/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.14/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.14/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.17/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.17/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.17/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.19/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.19/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.19/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.23/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.23/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.23/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.25/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.25/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.25/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.28/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.28/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.28/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.30/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.30/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.30/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.37/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.37/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.37/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.40/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.40/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.40/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.43/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.43/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.43/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.45/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.45/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.45/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.48/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.48/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.48/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.52/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.52/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.52/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.54/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.54/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.54/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.57/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.57/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.57/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.60/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.60/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.60/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.62/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.62/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.62/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.65/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.65/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.65/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.68/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.68/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.68/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.70/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.70/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.70/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.73/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.73/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.73/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.75/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.75/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.75/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.77/m.0/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.77/m.0/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.77/m.0/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.77/m.2/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.77/m.2/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.77/m.2/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.1/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.1/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.1/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.1/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.2/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.3/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.2/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.2/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.2/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.4/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.4/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.4/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.4/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.5/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.5/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.5/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.5/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.7/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.7/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.7/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.7/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.9/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.9/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.9/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.9/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.11/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.11/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.11/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.11/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.12/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.12/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.12/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.12/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.14/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.14/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.14/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.14/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.50/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.16/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.17/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.50/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.50/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.50/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.17/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.17/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.17/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.18/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.18/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.18/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.18/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.19/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.19/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.19/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.19/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.21/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.21/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.21/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.21/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.40/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.23/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.24/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.40/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.40/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.40/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.24/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.24/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.24/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.25/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.25/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.25/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.25/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.26/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.26/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.26/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.26/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.28/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.28/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.28/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.28/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.29/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.30/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.29/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.29/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.29/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.35/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.35/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.35/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.35/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.37/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.37/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.37/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.37/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.38/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.38/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.38/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.38/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.42/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.42/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.42/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.42/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.44/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.44/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.44/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.44/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.45/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.45/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.45/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.45/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.47/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.47/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.47/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.47/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.48/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.48/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.48/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.48/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.52/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.52/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.52/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.52/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.54/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.54/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.54/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.54/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.55/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.55/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.55/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.55/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.57/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.57/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.57/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.57/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.58/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.74/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.58/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.58/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.58/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.77/m.0/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.60/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.61/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.77/m.0/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.77/m.0/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.77/m.0/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.61/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.61/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.61/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.62/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.62/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.62/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.62/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.63/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.63/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.63/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.63/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.65/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.65/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.65/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.65/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.66/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.75/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.66/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.66/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.66/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.77/m.1/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.68/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.69/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.77/m.1/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.77/m.1/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.77/m.1/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.69/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.69/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.69/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.70/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.70/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.70/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.70/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.71/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.71/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.71/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.71/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.73/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.73/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.73/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.73/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.76/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.76/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.76/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.76/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.77/m.2/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.77/m.2/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.77/m.2/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.77/m.2/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.0/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.0/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.0/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.2/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.2/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.2/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.4/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.4/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.4/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.7/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.7/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.7/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.10/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.10/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.10/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.12/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.12/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.12/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.16/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.16/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.16/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.18/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.18/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.18/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.21/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.21/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.21/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.24/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.24/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.24/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.26/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.26/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.26/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.29/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.29/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.29/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.35/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.35/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.35/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.38/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.38/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.38/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.42/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.42/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.42/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.44/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.44/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.44/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.47/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.47/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.47/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.50/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.50/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.50/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.53/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.53/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.53/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.55/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.55/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.55/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.58/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.58/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.58/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.61/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.61/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.61/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.63/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.63/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.63/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.66/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.66/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.66/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.69/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.69/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.69/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.71/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.71/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.71/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.74/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.74/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.74/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.76/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.76/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.76/conv/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.77/m.1/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.77/m.1/_weight_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.77/m.1/_weight_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.3/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.3/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.3/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.16/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.16/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.16/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.23/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.23/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.23/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.30/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.30/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.30/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.74/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.74/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.74/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.60/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.60/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.60/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.75/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.75/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.75/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] Running: ConstQDQInitializersFusion on /model.68/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.68/conv/_input_quantizer/Constant_output_0 [04/18/2023-13:39:19] [V] [TRT] Removing /model.68/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-13:39:19] [V] [TRT] After Myelin optimization: 465 layers [04/18/2023-13:39:19] [V] [TRT] QDQ graph optimizer - constant folding of Q/DQ initializers [04/18/2023-13:39:19] [V] [TRT] QDQ graph optimizer forward pass - DQ motions and fusions [04/18/2023-13:39:19] [V] [TRT] QDQ graph optimizer backward pass [04/18/2023-13:39:19] [V] [TRT] QDQ graph optimizer quantization pass - Generate quantized ops [04/18/2023-13:39:19] [V] [TRT] Running: SplitDQAcrossFanOut on /model.9/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.9/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: SplitDQAcrossFanOut on /model.42/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.42/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: SplitDQAcrossFanOut on /model.52/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.52/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.0.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.0.conv.weight with /model.0/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.1.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.1.conv.weight with /model.1/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.2.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.2.conv.weight with /model.2/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.3.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.3.conv.weight with /model.3/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.4.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.4.conv.weight with /model.4/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.5.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.5.conv.weight with /model.5/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.7.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.7.conv.weight with /model.7/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.9.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.9.conv.weight with /model.9/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.10.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.10.conv.weight with /model.10/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.11.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.11.conv.weight with /model.11/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.12.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.12.conv.weight with /model.12/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.14.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.14.conv.weight with /model.14/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.16.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.16.conv.weight with /model.16/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.17.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.17.conv.weight with /model.17/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.18.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.18.conv.weight with /model.18/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.19.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.19.conv.weight with /model.19/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.21.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.21.conv.weight with /model.21/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.23.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.23.conv.weight with /model.23/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.24.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.24.conv.weight with /model.24/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.25.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.25.conv.weight with /model.25/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.26.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.26.conv.weight with /model.26/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.28.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.28.conv.weight with /model.28/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.29.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.29.conv.weight with /model.29/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.30.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.30.conv.weight with /model.30/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.35.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.35.conv.weight with /model.35/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.37.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.37.conv.weight with /model.37/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.38.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.38.conv.weight with /model.38/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.40.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.40.conv.weight with /model.40/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.42.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.42.conv.weight with /model.42/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.43.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.43.conv.weight with /model.43/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.44.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.44.conv.weight with /model.44/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.45.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.45.conv.weight with /model.45/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.47.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.47.conv.weight with /model.47/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.48.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.48.conv.weight with /model.48/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.50.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.50.conv.weight with /model.50/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.52.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.52.conv.weight with /model.52/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.53.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.53.conv.weight with /model.53/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.54.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.54.conv.weight with /model.54/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.55.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.55.conv.weight with /model.55/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.57.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.57.conv.weight with /model.57/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.58.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.58.conv.weight with /model.58/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.60.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.60.conv.weight with /model.60/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.61.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.61.conv.weight with /model.61/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.62.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.62.conv.weight with /model.62/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.63.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.63.conv.weight with /model.63/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.65.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.65.conv.weight with /model.65/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.66.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.66.conv.weight with /model.66/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.68.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.68.conv.weight with /model.68/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.69.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.69.conv.weight with /model.69/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.70.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.70.conv.weight with /model.70/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.71.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.71.conv.weight with /model.71/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.73.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.73.conv.weight with /model.73/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.74.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.74.conv.weight with /model.74/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.75.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.75.conv.weight with /model.75/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.76.conv.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.76.conv.weight with /model.76/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.77.m.0.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.77.m.0.weight with /model.77/m.0/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.77.m.1.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.77.m.1.weight with /model.77/m.1/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.77.m.2.weight [04/18/2023-13:39:19] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.77.m.2.weight with /model.77/m.2/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: ConstEltFusion on /model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] [04/18/2023-13:39:19] [V] [TRT] ConstEltFusion: Fusing /model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] with /model.77/Mul [04/18/2023-13:39:19] [V] [TRT] Running: ConstEltFusion on /model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] [04/18/2023-13:39:19] [V] [TRT] ConstEltFusion: Fusing /model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] with /model.77/Mul_2 [04/18/2023-13:39:19] [V] [TRT] Running: ConstEltFusion on /model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] [04/18/2023-13:39:19] [V] [TRT] ConstEltFusion: Fusing /model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] with /model.77/Mul_4 [04/18/2023-13:39:19] [V] [TRT] Running: VanillaSwapWithFollowingQ on /model.8/m/MaxPool [04/18/2023-13:39:19] [V] [TRT] Swapping /model.8/m/MaxPool with /model.9/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: HorizontalMergeQNodes on /model.2/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Eliminating /model.3/conv/_input_quantizer/QuantizeLinear which duplicates (Q) /model.2/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.3/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: HorizontalMergeQNodes on /model.29/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Eliminating /model.30/conv/_input_quantizer/QuantizeLinear which duplicates (Q) /model.29/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.30/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: HorizontalMergeQNodes on /model.58/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Eliminating /model.74/conv/_input_quantizer/QuantizeLinear which duplicates (Q) /model.58/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.74/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: HorizontalMergeQNodes on /model.66/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Eliminating /model.75/conv/_input_quantizer/QuantizeLinear which duplicates (Q) /model.66/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Removing /model.75/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:19] [V] [TRT] Running: SplitQAcrossPrecedingFanIn on /model.6/Concat [04/18/2023-13:39:19] [V] [TRT] Running: SplitQAcrossPrecedingFanIn on /model.13/Concat [04/18/2023-13:39:19] [V] [TRT] Running: SplitQAcrossPrecedingFanIn on /model.20/Concat [04/18/2023-13:39:19] [V] [TRT] Running: SplitQAcrossPrecedingFanIn on /model.27/Concat [04/18/2023-13:39:19] [V] [TRT] Running: SplitQAcrossPrecedingFanIn on /model.34/Concat [04/18/2023-13:39:19] [V] [TRT] Running: SplitQAcrossPrecedingFanIn on /model.36/Concat [04/18/2023-13:39:19] [V] [TRT] Running: SplitQAcrossPrecedingFanIn on /model.41/Concat [04/18/2023-13:39:19] [V] [TRT] Running: SplitQAcrossPrecedingFanIn on /model.46/Concat [04/18/2023-13:39:19] [V] [TRT] Running: SplitQAcrossPrecedingFanIn on /model.51/Concat [04/18/2023-13:39:19] [V] [TRT] Running: SplitQAcrossPrecedingFanIn on /model.56/Concat [04/18/2023-13:39:19] [V] [TRT] Running: SplitQAcrossPrecedingFanIn on /model.64/Concat [04/18/2023-13:39:19] [V] [TRT] Running: SplitQAcrossPrecedingFanIn on /model.72/Concat [04/18/2023-13:39:19] [V] [TRT] Running: VanillaSwapWithFollowingQ on /model.31/m/MaxPool [04/18/2023-13:39:19] [V] [TRT] Swapping /model.31/m/MaxPool with /model.35/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-13:39:19] [V] [TRT] Running: VanillaSwapWithFollowingQ on /model.32/m/MaxPool [04/18/2023-13:39:19] [V] [TRT] Swapping /model.32/m/MaxPool with /model.35/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-13:39:19] [V] [TRT] Running: VanillaSwapWithFollowingQ on /model.33/m/MaxPool [04/18/2023-13:39:19] [V] [TRT] Swapping /model.33/m/MaxPool with /model.35/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-13:39:19] [V] [TRT] Running: VanillaSwapWithFollowingQ on /model.39/Resize [04/18/2023-13:39:19] [V] [TRT] Swapping /model.39/Resize with /model.42/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-13:39:19] [V] [TRT] Running: VanillaSwapWithFollowingQ on /model.49/Resize [04/18/2023-13:39:19] [V] [TRT] Swapping /model.49/Resize with /model.52/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-13:39:20] [V] [TRT] Running: HorizontalMergeQNodes on /model.4/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Eliminating /model.7/conv/_input_quantizer/QuantizeLinear_clone_2 which duplicates (Q) /model.4/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.7/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-13:39:20] [V] [TRT] Running: HorizontalMergeQNodes on /model.5/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Eliminating /model.7/conv/_input_quantizer/QuantizeLinear_clone_1 which duplicates (Q) /model.5/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.7/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-13:39:20] [V] [TRT] Running: HorizontalMergeQNodes on /model.11/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Eliminating /model.14/conv/_input_quantizer/QuantizeLinear_clone_2 which duplicates (Q) /model.11/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.14/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-13:39:20] [V] [TRT] Running: HorizontalMergeQNodes on /model.12/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Eliminating /model.14/conv/_input_quantizer/QuantizeLinear_clone_1 which duplicates (Q) /model.12/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.14/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-13:39:20] [V] [TRT] Running: HorizontalMergeQNodes on /model.18/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Eliminating /model.21/conv/_input_quantizer/QuantizeLinear_clone_2 which duplicates (Q) /model.18/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.21/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-13:39:20] [V] [TRT] Running: HorizontalMergeQNodes on /model.19/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Eliminating /model.21/conv/_input_quantizer/QuantizeLinear_clone_1 which duplicates (Q) /model.19/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.21/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-13:39:20] [V] [TRT] Running: HorizontalMergeQNodes on /model.25/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Eliminating /model.28/conv/_input_quantizer/QuantizeLinear_clone_2 which duplicates (Q) /model.25/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.28/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-13:39:20] [V] [TRT] Running: HorizontalMergeQNodes on /model.26/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Eliminating /model.28/conv/_input_quantizer/QuantizeLinear_clone_1 which duplicates (Q) /model.26/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.28/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-13:39:20] [V] [TRT] Running: HorizontalMergeQNodes on /model.35/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-13:39:20] [V] [TRT] Eliminating /model.35/conv/_input_quantizer/QuantizeLinear_clone_3 which duplicates (Q) /model.35/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-13:39:20] [V] [TRT] Eliminating /model.35/conv/_input_quantizer/QuantizeLinear_clone_1 which duplicates (Q) /model.35/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-13:39:20] [V] [TRT] Eliminating /model.35/conv/_input_quantizer/QuantizeLinear_clone_0 which duplicates (Q) /model.35/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-13:39:20] [V] [TRT] Removing /model.35/conv/_input_quantizer/QuantizeLinear_clone_3 [04/18/2023-13:39:20] [V] [TRT] Removing /model.35/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-13:39:20] [V] [TRT] Removing /model.35/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-13:39:20] [V] [TRT] Running: HorizontalMergeQNodes on /model.44/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Eliminating /model.47/conv/_input_quantizer/QuantizeLinear_clone_2 which duplicates (Q) /model.44/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.47/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-13:39:20] [V] [TRT] Running: HorizontalMergeQNodes on /model.45/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Eliminating /model.47/conv/_input_quantizer/QuantizeLinear_clone_1 which duplicates (Q) /model.45/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.47/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-13:39:20] [V] [TRT] Running: HorizontalMergeQNodes on /model.54/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Eliminating /model.57/conv/_input_quantizer/QuantizeLinear_clone_2 which duplicates (Q) /model.54/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.57/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-13:39:20] [V] [TRT] Running: HorizontalMergeQNodes on /model.55/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Eliminating /model.57/conv/_input_quantizer/QuantizeLinear_clone_1 which duplicates (Q) /model.55/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.57/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-13:39:20] [V] [TRT] Running: HorizontalMergeQNodes on /model.62/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Eliminating /model.65/conv/_input_quantizer/QuantizeLinear_clone_2 which duplicates (Q) /model.62/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.65/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-13:39:20] [V] [TRT] Running: HorizontalMergeQNodes on /model.63/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Eliminating /model.65/conv/_input_quantizer/QuantizeLinear_clone_1 which duplicates (Q) /model.63/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.65/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-13:39:20] [V] [TRT] Running: HorizontalMergeQNodes on /model.70/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Eliminating /model.73/conv/_input_quantizer/QuantizeLinear_clone_2 which duplicates (Q) /model.70/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.73/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-13:39:20] [V] [TRT] Running: HorizontalMergeQNodes on /model.71/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Eliminating /model.73/conv/_input_quantizer/QuantizeLinear_clone_1 which duplicates (Q) /model.71/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.73/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-13:39:20] [V] [TRT] Running: PointWiseFusion on /model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle] [04/18/2023-13:39:20] [V] [TRT] PointWiseFusion: Fusing /model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle] with /model.77/Pow [04/18/2023-13:39:20] [V] [TRT] Running: PointWiseFusion on /model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle] [04/18/2023-13:39:20] [V] [TRT] PointWiseFusion: Fusing /model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle] with /model.77/Pow_1 [04/18/2023-13:39:20] [V] [TRT] Running: PointWiseFusion on /model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul [04/18/2023-13:39:20] [V] [TRT] PointWiseFusion: Fusing /model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul with /model.77/Add [04/18/2023-13:39:20] [V] [TRT] Running: PointWiseFusion on PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow) [04/18/2023-13:39:20] [V] [TRT] PointWiseFusion: Fusing PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow) with /model.77/Mul_1 [04/18/2023-13:39:20] [V] [TRT] Running: PointWiseFusion on /model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2 [04/18/2023-13:39:20] [V] [TRT] PointWiseFusion: Fusing /model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2 with /model.77/Add_1 [04/18/2023-13:39:20] [V] [TRT] Running: PointWiseFusion on PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1) [04/18/2023-13:39:20] [V] [TRT] PointWiseFusion: Fusing PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1) with /model.77/Mul_3 [04/18/2023-13:39:20] [V] [TRT] Running: PointWiseFusion on /model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4 [04/18/2023-13:39:20] [V] [TRT] PointWiseFusion: Fusing /model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4 with /model.77/Add_2 [04/18/2023-13:39:20] [V] [TRT] Running: PointWiseFusion on /model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle] [04/18/2023-13:39:20] [V] [TRT] PointWiseFusion: Fusing /model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle] with /model.77/Pow_2 [04/18/2023-13:39:20] [V] [TRT] Running: PointWiseFusion on PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2) [04/18/2023-13:39:20] [V] [TRT] PointWiseFusion: Fusing PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2) with /model.77/Mul_5 [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.0/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.0/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.1/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.1/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.2/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.2/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.3/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.3/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.4/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.4/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.5/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.5/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.7/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.7/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.9/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.9/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.10/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.10/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.11/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.11/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.12/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.12/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.14/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.14/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.50/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.50/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.16/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.16/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.17/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.17/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.18/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.18/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.19/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.19/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.21/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.21/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.40/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.40/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.23/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.23/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.24/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.24/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.25/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.25/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.26/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.26/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.28/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.28/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.29/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.29/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.30/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.30/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.35/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.35/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.37/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.37/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.38/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.38/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.42/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.42/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.43/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.43/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.44/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.44/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.45/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.45/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.47/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.47/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.48/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.48/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.52/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.52/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.53/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.53/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.54/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.54/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.55/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.55/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.57/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.57/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.58/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.58/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.74/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.74/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.60/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.60/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.61/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.61/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.77/Sigmoid [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.77/Sigmoid from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.62/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.62/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.63/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.63/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.65/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.65/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.66/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.66/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.75/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.75/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.68/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.68/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.69/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.69/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.77/Sigmoid_1 [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.77/Sigmoid_1 from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.70/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.70/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.71/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.71/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.73/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.73/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.76/act/LeakyRelu [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.76/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ActivationToPointwiseConversion on /model.77/Sigmoid_2 [04/18/2023-13:39:20] [V] [TRT] Swap the layer type of /model.77/Sigmoid_2 from ACTIVATION to POINTWISE [04/18/2023-13:39:20] [V] [TRT] Running: ShufflePointWiseSwap on /model.77/Reshape + /model.77/Transpose [04/18/2023-13:39:20] [V] [TRT] Swapping /model.77/Reshape + /model.77/Transpose with PWN(/model.77/Sigmoid) [04/18/2023-13:39:20] [V] [TRT] Running: ShufflePointWiseSwap on /model.77/Reshape_2 + /model.77/Transpose_1 [04/18/2023-13:39:20] [V] [TRT] Swapping /model.77/Reshape_2 + /model.77/Transpose_1 with PWN(/model.77/Sigmoid_1) [04/18/2023-13:39:20] [V] [TRT] Running: ShufflePointWiseSwap on /model.77/Reshape_4 + /model.77/Transpose_2 [04/18/2023-13:39:20] [V] [TRT] Swapping /model.77/Reshape_4 + /model.77/Transpose_2 with PWN(/model.77/Sigmoid_2) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.1/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.1/conv/Conv with PWN(/model.1/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.2/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.2/conv/Conv with PWN(/model.2/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.3/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.3/conv/Conv with PWN(/model.3/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.4/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.4/conv/Conv with PWN(/model.4/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.5/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.5/conv/Conv with PWN(/model.5/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.7/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.7/conv/Conv with PWN(/model.7/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.9/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.9/conv/Conv with PWN(/model.9/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.10/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.10/conv/Conv with PWN(/model.10/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.11/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.11/conv/Conv with PWN(/model.11/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.12/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.12/conv/Conv with PWN(/model.12/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.14/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.14/conv/Conv with PWN(/model.14/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.50/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.50/conv/Conv with PWN(/model.50/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.16/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.16/conv/Conv with PWN(/model.16/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.17/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.17/conv/Conv with PWN(/model.17/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.18/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.18/conv/Conv with PWN(/model.18/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.19/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.19/conv/Conv with PWN(/model.19/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.21/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.21/conv/Conv with PWN(/model.21/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.40/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.40/conv/Conv with PWN(/model.40/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.23/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.23/conv/Conv with PWN(/model.23/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.24/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.24/conv/Conv with PWN(/model.24/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.25/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.25/conv/Conv with PWN(/model.25/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.26/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.26/conv/Conv with PWN(/model.26/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.28/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.28/conv/Conv with PWN(/model.28/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.29/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.29/conv/Conv with PWN(/model.29/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.30/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.30/conv/Conv with PWN(/model.30/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.35/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.35/conv/Conv with PWN(/model.35/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.37/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.37/conv/Conv with PWN(/model.37/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.38/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.38/conv/Conv with PWN(/model.38/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.42/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.42/conv/Conv with PWN(/model.42/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.43/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.43/conv/Conv with PWN(/model.43/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.44/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.44/conv/Conv with PWN(/model.44/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.45/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.45/conv/Conv with PWN(/model.45/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.47/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.47/conv/Conv with PWN(/model.47/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.48/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.48/conv/Conv with PWN(/model.48/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.52/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.52/conv/Conv with PWN(/model.52/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.53/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.53/conv/Conv with PWN(/model.53/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.54/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.54/conv/Conv with PWN(/model.54/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.55/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.55/conv/Conv with PWN(/model.55/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.57/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.57/conv/Conv with PWN(/model.57/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.58/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.58/conv/Conv with PWN(/model.58/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.74/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.74/conv/Conv with PWN(/model.74/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.60/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.60/conv/Conv with PWN(/model.60/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.61/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.61/conv/Conv with PWN(/model.61/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.62/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.62/conv/Conv with PWN(/model.62/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.63/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.63/conv/Conv with PWN(/model.63/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.65/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.65/conv/Conv with PWN(/model.65/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.66/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.66/conv/Conv with PWN(/model.66/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.75/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.75/conv/Conv with PWN(/model.75/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.68/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.68/conv/Conv with PWN(/model.68/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.69/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.69/conv/Conv with PWN(/model.69/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.70/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.70/conv/Conv with PWN(/model.70/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.71/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.71/conv/Conv with PWN(/model.71/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.73/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.73/conv/Conv with PWN(/model.73/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: GenericConvActFusion on /model.76/conv/Conv [04/18/2023-13:39:20] [V] [TRT] GenericConvActFusion: Fusing /model.76/conv/Conv with PWN(/model.76/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.0/conv/Conv [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.0/conv/_input_quantizer/DequantizeLinear and /model.0/conv/_weight_quantizer/DequantizeLinear) into /model.0/conv/Conv [04/18/2023-13:39:20] [V] [TRT] Removing /model.0/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.0/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.2/conv/_input_quantizer/QuantizeLinear into /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.1/conv/_input_quantizer/DequantizeLinear and /model.1/conv/_weight_quantizer/DequantizeLinear) into /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.2/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.1/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.1/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.7/conv/_input_quantizer/QuantizeLinear_clone_3 into /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.2/conv/_input_quantizer/DequantizeLinear and /model.2/conv/_weight_quantizer/DequantizeLinear) into /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.7/conv/_input_quantizer/QuantizeLinear_clone_3 [04/18/2023-13:39:20] [V] [TRT] Removing /model.2/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.2/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.5/conv/_input_quantizer/QuantizeLinear into /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.4/conv/_input_quantizer/DequantizeLinear and /model.4/conv/_weight_quantizer/DequantizeLinear) into /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.5/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.4/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.4/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.7/conv/_input_quantizer/QuantizeLinear_clone_0 into /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.5/conv/_input_quantizer/DequantizeLinear and /model.5/conv/_weight_quantizer/DequantizeLinear) into /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.7/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-13:39:20] [V] [TRT] Removing /model.5/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.5/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.9/conv/_input_quantizer/QuantizeLinear into /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.7/conv/_input_quantizer/DequantizeLinear and /model.7/conv/_weight_quantizer/DequantizeLinear) into /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.9/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.7/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.7/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.14/conv/_input_quantizer/QuantizeLinear_clone_3 into /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.9/conv/_input_quantizer/DequantizeLinear_clone_0 and /model.9/conv/_weight_quantizer/DequantizeLinear) into /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.14/conv/_input_quantizer/QuantizeLinear_clone_3 [04/18/2023-13:39:20] [V] [TRT] Removing /model.9/conv/_input_quantizer/DequantizeLinear_clone_0 [04/18/2023-13:39:20] [V] [TRT] Removing /model.9/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.12/conv/_input_quantizer/QuantizeLinear into /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.11/conv/_input_quantizer/DequantizeLinear and /model.11/conv/_weight_quantizer/DequantizeLinear) into /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.12/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.11/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.11/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.14/conv/_input_quantizer/QuantizeLinear_clone_0 into /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.12/conv/_input_quantizer/DequantizeLinear and /model.12/conv/_weight_quantizer/DequantizeLinear) into /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.14/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-13:39:20] [V] [TRT] Removing /model.12/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.12/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.14/conv/_input_quantizer/DequantizeLinear and /model.14/conv/_weight_quantizer/DequantizeLinear) into /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.14/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.14/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.52/conv/_input_quantizer/QuantizeLinear_clone_0 into /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.50/conv/_input_quantizer/DequantizeLinear and /model.50/conv/_weight_quantizer/DequantizeLinear) into /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.52/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-13:39:20] [V] [TRT] Removing /model.50/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.50/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.18/conv/_input_quantizer/QuantizeLinear into /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.17/conv/_input_quantizer/DequantizeLinear and /model.17/conv/_weight_quantizer/DequantizeLinear) into /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.18/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.17/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.17/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.19/conv/_input_quantizer/QuantizeLinear into /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.18/conv/_input_quantizer/DequantizeLinear and /model.18/conv/_weight_quantizer/DequantizeLinear) into /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.19/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.18/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.18/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.21/conv/_input_quantizer/QuantizeLinear_clone_0 into /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.19/conv/_input_quantizer/DequantizeLinear and /model.19/conv/_weight_quantizer/DequantizeLinear) into /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.21/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-13:39:20] [V] [TRT] Removing /model.19/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.19/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.21/conv/_input_quantizer/DequantizeLinear and /model.21/conv/_weight_quantizer/DequantizeLinear) into /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.21/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.21/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.42/conv/_input_quantizer/QuantizeLinear_clone_0 into /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.40/conv/_input_quantizer/DequantizeLinear and /model.40/conv/_weight_quantizer/DequantizeLinear) into /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.42/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-13:39:20] [V] [TRT] Removing /model.40/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.40/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.25/conv/_input_quantizer/QuantizeLinear into /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.24/conv/_input_quantizer/DequantizeLinear and /model.24/conv/_weight_quantizer/DequantizeLinear) into /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.25/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.24/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.24/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.26/conv/_input_quantizer/QuantizeLinear into /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.25/conv/_input_quantizer/DequantizeLinear and /model.25/conv/_weight_quantizer/DequantizeLinear) into /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.26/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.25/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.25/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.28/conv/_input_quantizer/QuantizeLinear_clone_0 into /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.26/conv/_input_quantizer/DequantizeLinear and /model.26/conv/_weight_quantizer/DequantizeLinear) into /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.28/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-13:39:20] [V] [TRT] Removing /model.26/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.26/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.29/conv/_input_quantizer/QuantizeLinear into /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.28/conv/_input_quantizer/DequantizeLinear and /model.28/conv/_weight_quantizer/DequantizeLinear) into /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.29/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.28/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.28/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.37/conv/_input_quantizer/QuantizeLinear_clone_1 into /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.29/conv/_input_quantizer/DequantizeLinear and /model.29/conv/_weight_quantizer/DequantizeLinear) into /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.37/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-13:39:20] [V] [TRT] Removing /model.29/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.29/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.37/conv/_input_quantizer/QuantizeLinear_clone_0 into /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.35/conv/_input_quantizer/DequantizeLinear and /model.35/conv/_weight_quantizer/DequantizeLinear) into /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.37/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-13:39:20] [V] [TRT] Removing /model.35/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.35/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.37/conv/_input_quantizer/DequantizeLinear and /model.37/conv/_weight_quantizer/DequantizeLinear) into /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.37/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.37/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.42/conv/_input_quantizer/QuantizeLinear_clone_1 into /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.38/conv/_input_quantizer/DequantizeLinear and /model.38/conv/_weight_quantizer/DequantizeLinear) into /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.42/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-13:39:20] [V] [TRT] Removing /model.38/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.38/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.47/conv/_input_quantizer/QuantizeLinear_clone_3 into /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.42/conv/_input_quantizer/DequantizeLinear_clone_0 and /model.42/conv/_weight_quantizer/DequantizeLinear) into /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.47/conv/_input_quantizer/QuantizeLinear_clone_3 [04/18/2023-13:39:20] [V] [TRT] Removing /model.42/conv/_input_quantizer/DequantizeLinear_clone_0 [04/18/2023-13:39:20] [V] [TRT] Removing /model.42/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.45/conv/_input_quantizer/QuantizeLinear into /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.44/conv/_input_quantizer/DequantizeLinear and /model.44/conv/_weight_quantizer/DequantizeLinear) into /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.45/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.44/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.44/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.47/conv/_input_quantizer/QuantizeLinear_clone_0 into /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.45/conv/_input_quantizer/DequantizeLinear and /model.45/conv/_weight_quantizer/DequantizeLinear) into /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.47/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-13:39:20] [V] [TRT] Removing /model.45/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.45/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.47/conv/_input_quantizer/DequantizeLinear and /model.47/conv/_weight_quantizer/DequantizeLinear) into /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.47/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.47/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.52/conv/_input_quantizer/QuantizeLinear_clone_1 into /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.48/conv/_input_quantizer/DequantizeLinear and /model.48/conv/_weight_quantizer/DequantizeLinear) into /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.52/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-13:39:20] [V] [TRT] Removing /model.48/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.48/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.57/conv/_input_quantizer/QuantizeLinear_clone_3 into /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.52/conv/_input_quantizer/DequantizeLinear_clone_0 and /model.52/conv/_weight_quantizer/DequantizeLinear) into /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.57/conv/_input_quantizer/QuantizeLinear_clone_3 [04/18/2023-13:39:20] [V] [TRT] Removing /model.52/conv/_input_quantizer/DequantizeLinear_clone_0 [04/18/2023-13:39:20] [V] [TRT] Removing /model.52/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.55/conv/_input_quantizer/QuantizeLinear into /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.54/conv/_input_quantizer/DequantizeLinear and /model.54/conv/_weight_quantizer/DequantizeLinear) into /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.55/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.54/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.54/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.57/conv/_input_quantizer/QuantizeLinear_clone_0 into /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.55/conv/_input_quantizer/DequantizeLinear and /model.55/conv/_weight_quantizer/DequantizeLinear) into /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.57/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-13:39:20] [V] [TRT] Removing /model.55/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.55/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.58/conv/_input_quantizer/QuantizeLinear into /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.57/conv/_input_quantizer/DequantizeLinear and /model.57/conv/_weight_quantizer/DequantizeLinear) into /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.58/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.57/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.57/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.58/conv/_input_quantizer/DequantizeLinear and /model.58/conv/_weight_quantizer/DequantizeLinear) into /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.58/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.58/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.77/m.0/Conv [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.77/m.0/_input_quantizer/DequantizeLinear and /model.77/m.0/_weight_quantizer/DequantizeLinear) into /model.77/m.0/Conv [04/18/2023-13:39:20] [V] [TRT] Removing /model.77/m.0/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.77/m.0/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.62/conv/_input_quantizer/QuantizeLinear into /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.61/conv/_input_quantizer/DequantizeLinear and /model.61/conv/_weight_quantizer/DequantizeLinear) into /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.62/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.61/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.61/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.63/conv/_input_quantizer/QuantizeLinear into /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.62/conv/_input_quantizer/DequantizeLinear and /model.62/conv/_weight_quantizer/DequantizeLinear) into /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.63/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.62/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.62/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.65/conv/_input_quantizer/QuantizeLinear_clone_0 into /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.63/conv/_input_quantizer/DequantizeLinear and /model.63/conv/_weight_quantizer/DequantizeLinear) into /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.65/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-13:39:20] [V] [TRT] Removing /model.63/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.63/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.66/conv/_input_quantizer/QuantizeLinear into /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.65/conv/_input_quantizer/DequantizeLinear and /model.65/conv/_weight_quantizer/DequantizeLinear) into /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.66/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.65/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.65/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.66/conv/_input_quantizer/DequantizeLinear and /model.66/conv/_weight_quantizer/DequantizeLinear) into /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.66/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.66/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.77/m.1/Conv [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.77/m.1/_input_quantizer/DequantizeLinear and /model.77/m.1/_weight_quantizer/DequantizeLinear) into /model.77/m.1/Conv [04/18/2023-13:39:20] [V] [TRT] Removing /model.77/m.1/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.77/m.1/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.70/conv/_input_quantizer/QuantizeLinear into /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.69/conv/_input_quantizer/DequantizeLinear and /model.69/conv/_weight_quantizer/DequantizeLinear) into /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.70/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.69/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.69/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.71/conv/_input_quantizer/QuantizeLinear into /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.70/conv/_input_quantizer/DequantizeLinear and /model.70/conv/_weight_quantizer/DequantizeLinear) into /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.71/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.70/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.70/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.73/conv/_input_quantizer/QuantizeLinear_clone_0 into /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.71/conv/_input_quantizer/DequantizeLinear and /model.71/conv/_weight_quantizer/DequantizeLinear) into /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.73/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-13:39:20] [V] [TRT] Removing /model.71/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.71/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.76/conv/_input_quantizer/QuantizeLinear into /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.73/conv/_input_quantizer/DequantizeLinear and /model.73/conv/_weight_quantizer/DequantizeLinear) into /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.76/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.73/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.73/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.77/m.2/_input_quantizer/QuantizeLinear into /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.76/conv/_input_quantizer/DequantizeLinear and /model.76/conv/_weight_quantizer/DequantizeLinear) into /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.77/m.2/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.76/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.76/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.77/m.2/Conv [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.77/m.2/_input_quantizer/DequantizeLinear and /model.77/m.2/_weight_quantizer/DequantizeLinear) into /model.77/m.2/Conv [04/18/2023-13:39:20] [V] [TRT] Removing /model.77/m.2/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.77/m.2/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.4/conv/_input_quantizer/QuantizeLinear into /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.3/conv/_input_quantizer/DequantizeLinear and /model.3/conv/_weight_quantizer/DequantizeLinear) into /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.4/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.3/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.3/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.11/conv/_input_quantizer/QuantizeLinear into /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.9/conv/_input_quantizer/DequantizeLinear_clone_1 and /model.10/conv/_weight_quantizer/DequantizeLinear) into /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.11/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.9/conv/_input_quantizer/DequantizeLinear_clone_1 [04/18/2023-13:39:20] [V] [TRT] Removing /model.10/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.21/conv/_input_quantizer/QuantizeLinear_clone_3 into /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.16/conv/_input_quantizer/DequantizeLinear and /model.16/conv/_weight_quantizer/DequantizeLinear) into /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.21/conv/_input_quantizer/QuantizeLinear_clone_3 [04/18/2023-13:39:20] [V] [TRT] Removing /model.16/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.16/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.28/conv/_input_quantizer/QuantizeLinear_clone_3 into /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.23/conv/_input_quantizer/DequantizeLinear and /model.23/conv/_weight_quantizer/DequantizeLinear) into /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.28/conv/_input_quantizer/QuantizeLinear_clone_3 [04/18/2023-13:39:20] [V] [TRT] Removing /model.23/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.23/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.35/conv/_input_quantizer/QuantizeLinear_clone_2 into /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.30/conv/_input_quantizer/DequantizeLinear and /model.30/conv/_weight_quantizer/DequantizeLinear) into /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.35/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-13:39:20] [V] [TRT] Removing /model.30/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.30/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.44/conv/_input_quantizer/QuantizeLinear into /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.42/conv/_input_quantizer/DequantizeLinear_clone_1 and /model.43/conv/_weight_quantizer/DequantizeLinear) into /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.44/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.42/conv/_input_quantizer/DequantizeLinear_clone_1 [04/18/2023-13:39:20] [V] [TRT] Removing /model.43/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.54/conv/_input_quantizer/QuantizeLinear into /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.52/conv/_input_quantizer/DequantizeLinear_clone_1 and /model.53/conv/_weight_quantizer/DequantizeLinear) into /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.54/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.52/conv/_input_quantizer/DequantizeLinear_clone_1 [04/18/2023-13:39:20] [V] [TRT] Removing /model.53/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.77/m.0/_input_quantizer/QuantizeLinear into /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.74/conv/_input_quantizer/DequantizeLinear and /model.74/conv/_weight_quantizer/DequantizeLinear) into /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.77/m.0/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.74/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.74/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.65/conv/_input_quantizer/QuantizeLinear_clone_3 into /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.60/conv/_input_quantizer/DequantizeLinear and /model.60/conv/_weight_quantizer/DequantizeLinear) into /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.65/conv/_input_quantizer/QuantizeLinear_clone_3 [04/18/2023-13:39:20] [V] [TRT] Removing /model.60/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.60/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.77/m.1/_input_quantizer/QuantizeLinear into /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.75/conv/_input_quantizer/DequantizeLinear and /model.75/conv/_weight_quantizer/DequantizeLinear) into /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.77/m.1/_input_quantizer/QuantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.75/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.75/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.73/conv/_input_quantizer/QuantizeLinear_clone_3 into /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.68/conv/_input_quantizer/DequantizeLinear and /model.68/conv/_weight_quantizer/DequantizeLinear) into /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) [04/18/2023-13:39:20] [V] [TRT] Removing /model.73/conv/_input_quantizer/QuantizeLinear_clone_3 [04/18/2023-13:39:20] [V] [TRT] Removing /model.68/conv/_input_quantizer/DequantizeLinear [04/18/2023-13:39:20] [V] [TRT] Removing /model.68/conv/_weight_quantizer/DequantizeLinear [04/18/2023-13:39:21] [V] [TRT] Running: QuantizeGenericNodes on PWN(/model.0/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] QuantizeGenericNodes: fusing /model.1/conv/_input_quantizer/QuantizeLinear into PWN(/model.0/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Removing /model.1/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear with /model.0/conv/Conv [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear with /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear with /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear with /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear with /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear with /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear with /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear with /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear with /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear with /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear with /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear with /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear with /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear with /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear with /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear with /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear with /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear with /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear with /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear with /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear with /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear with /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear with /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear with /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear with /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear with /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear with /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear with /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear with /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear with /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear with /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear with /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear with /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear with /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear with /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear with /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear with /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear with /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear with /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear with /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear with /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear with /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear with /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear with /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear with /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear with /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear with /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear with /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear with /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear with /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear with /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear with /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear with /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear with /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear with /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear with /model.77/m.0/Conv [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear with /model.77/m.1/Conv [04/18/2023-13:39:21] [V] [TRT] Running: ConstWeightsFusion on model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] ConstWeightsFusion: Fusing model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear with /model.77/m.2/Conv [04/18/2023-13:39:21] [V] [TRT] After dupe layer removal: 128 layers [04/18/2023-13:39:21] [V] [TRT] After final dead-layer removal: 128 layers [04/18/2023-13:39:21] [V] [TRT] After tensor merging: 128 layers [04/18/2023-13:39:21] [V] [TRT] QDQ graph optimizer quantization epilogue pass [04/18/2023-13:39:21] [V] [TRT] QDQ optimization pass [04/18/2023-13:39:21] [V] [TRT] QDQ graph optimizer constant fold dangling QDQ pass [04/18/2023-13:39:21] [V] [TRT] Running: QDQToCopy on /model.0/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] Swap the layer type of /model.0/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-13:39:21] [V] [TRT] Running: QDQToCopy on /model.50/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] Swap the layer type of /model.50/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-13:39:21] [V] [TRT] Running: QDQToCopy on /model.16/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] Swap the layer type of /model.16/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-13:39:21] [V] [TRT] Running: QDQToCopy on /model.17/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] Swap the layer type of /model.17/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-13:39:21] [V] [TRT] Running: QDQToCopy on /model.40/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] Swap the layer type of /model.40/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-13:39:21] [V] [TRT] Running: QDQToCopy on /model.23/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] Swap the layer type of /model.23/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-13:39:21] [V] [TRT] Running: QDQToCopy on /model.24/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] Swap the layer type of /model.24/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-13:39:21] [V] [TRT] Running: QDQToCopy on /model.38/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] Swap the layer type of /model.38/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-13:39:21] [V] [TRT] Running: QDQToCopy on /model.48/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] Swap the layer type of /model.48/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-13:39:21] [V] [TRT] Running: QDQToCopy on /model.60/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] Swap the layer type of /model.60/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-13:39:21] [V] [TRT] Running: QDQToCopy on /model.61/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] Swap the layer type of /model.61/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-13:39:21] [V] [TRT] Running: QDQToCopy on /model.68/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] Swap the layer type of /model.68/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-13:39:21] [V] [TRT] Running: QDQToCopy on /model.69/conv/_input_quantizer/QuantizeLinear [04/18/2023-13:39:21] [V] [TRT] Swap the layer type of /model.69/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-13:39:21] [V] [TRT] After dupe layer removal: 128 layers [04/18/2023-13:39:21] [V] [TRT] After final dead-layer removal: 128 layers [04/18/2023-13:39:21] [V] [TRT] After tensor merging: 128 layers [04/18/2023-13:39:21] [V] [TRT] After vertical fusions: 128 layers [04/18/2023-13:39:21] [V] [TRT] After dupe layer removal: 128 layers [04/18/2023-13:39:21] [V] [TRT] After final dead-layer removal: 128 layers [04/18/2023-13:39:21] [V] [TRT] After tensor merging: 128 layers [04/18/2023-13:39:21] [V] [TRT] After slice removal: 128 layers [04/18/2023-13:39:21] [V] [TRT] Eliminating concatenation /model.77/Concat_3 [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.77/Reshape_1_output_0 to outputs [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.77/Reshape_3_output_0 to outputs [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.77/Reshape_5_output_0 to outputs [04/18/2023-13:39:21] [V] [TRT] Eliminating concatenation /model.77/Concat_2 [04/18/2023-13:39:21] [V] [TRT] Generating copy for /model.77/Add_2_output_0 to /model.77/Concat_2_output_0 because of stomping hazard. [04/18/2023-13:39:21] [V] [TRT] Generating copy for /model.77/Mul_5_output_0 to /model.77/Concat_2_output_0 because of stomping hazard. [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.77/Split_2_output_2 to /model.77/Concat_2_output_0 [04/18/2023-13:39:21] [V] [TRT] Eliminating concatenation /model.72/Concat [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.72/Concat_/model.71/act/LeakyRelu_output_0_clone_0 to /model.73/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:21] [V] [TRT] Generating copy for /model.71/conv/_input_quantizer/QuantizeLinear_output_0 to /model.73/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-13:39:21] [V] [TRT] Generating copy for /model.70/conv/_input_quantizer/QuantizeLinear_output_0 to /model.73/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3 to /model.73/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:21] [V] [TRT] Eliminating concatenation /model.77/Concat_1 [04/18/2023-13:39:21] [V] [TRT] Generating copy for /model.77/Add_1_output_0 to /model.77/Concat_1_output_0 because of stomping hazard. [04/18/2023-13:39:21] [V] [TRT] Generating copy for /model.77/Mul_3_output_0 to /model.77/Concat_1_output_0 because of stomping hazard. [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.77/Split_1_output_2 to /model.77/Concat_1_output_0 [04/18/2023-13:39:21] [V] [TRT] Eliminating concatenation /model.67/Concat [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.66/act/LeakyRelu_output_0 to /model.67/Concat_output_0 [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.37/act/LeakyRelu_output_0 to /model.67/Concat_output_0 [04/18/2023-13:39:21] [V] [TRT] Eliminating concatenation /model.64/Concat [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.64/Concat_/model.63/act/LeakyRelu_output_0_clone_0 to /model.65/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:21] [V] [TRT] Generating copy for /model.63/conv/_input_quantizer/QuantizeLinear_output_0 to /model.65/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-13:39:21] [V] [TRT] Generating copy for /model.62/conv/_input_quantizer/QuantizeLinear_output_0 to /model.65/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.64/Concat_/model.60/act/LeakyRelu_output_0_clone_3 to /model.65/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:21] [V] [TRT] Eliminating concatenation /model.77/Concat [04/18/2023-13:39:21] [V] [TRT] Generating copy for /model.77/Add_output_0 to /model.77/Concat_output_0 because of stomping hazard. [04/18/2023-13:39:21] [V] [TRT] Generating copy for /model.77/Mul_1_output_0 to /model.77/Concat_output_0 because of stomping hazard. [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.77/Split_output_2 to /model.77/Concat_output_0 [04/18/2023-13:39:21] [V] [TRT] Eliminating concatenation /model.59/Concat [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.58/act/LeakyRelu_output_0 to /model.59/Concat_output_0 [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.47/act/LeakyRelu_output_0 to /model.59/Concat_output_0 [04/18/2023-13:39:21] [V] [TRT] Eliminating concatenation /model.56/Concat [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.56/Concat_/model.55/act/LeakyRelu_output_0_clone_0 to /model.57/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:21] [V] [TRT] Generating copy for /model.55/conv/_input_quantizer/QuantizeLinear_output_0 to /model.57/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-13:39:21] [V] [TRT] Generating copy for /model.54/conv/_input_quantizer/QuantizeLinear_output_0 to /model.57/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3 to /model.57/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:21] [V] [TRT] Eliminating concatenation /model.51/Concat [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0 to /model.52/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:21] [V] [TRT] Generating copy for /model.51/Concat_/model.49/Resize_output_0_clone_1 to /model.52/conv/_input_quantizer/QuantizeLinear_output_0 because input does not support striding. [04/18/2023-13:39:21] [V] [TRT] Eliminating concatenation /model.46/Concat [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.46/Concat_/model.45/act/LeakyRelu_output_0_clone_0 to /model.47/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:21] [V] [TRT] Generating copy for /model.45/conv/_input_quantizer/QuantizeLinear_output_0 to /model.47/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-13:39:21] [V] [TRT] Generating copy for /model.44/conv/_input_quantizer/QuantizeLinear_output_0 to /model.47/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3 to /model.47/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:21] [V] [TRT] Eliminating concatenation /model.41/Concat [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0 to /model.42/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:21] [V] [TRT] Generating copy for /model.41/Concat_/model.39/Resize_output_0_clone_1 to /model.42/conv/_input_quantizer/QuantizeLinear_output_0 because input does not support striding. [04/18/2023-13:39:21] [V] [TRT] Eliminating concatenation /model.36/Concat [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.36/Concat_/model.35/act/LeakyRelu_output_0_clone_0 to /model.37/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1 to /model.37/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:21] [V] [TRT] Eliminating concatenation /model.34/Concat [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.34/Concat_/model.33/m/MaxPool_output_0_clone_0 to /model.35/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.34/Concat_/model.32/m/MaxPool_output_0_clone_1 to /model.35/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.34/Concat_/model.31/m/MaxPool_output_0_clone_2 to /model.35/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:21] [V] [TRT] Generating copy for /model.31/m/MaxPool_output_0 to /model.35/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-13:39:21] [V] [TRT] Eliminating concatenation /model.27/Concat [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.27/Concat_/model.26/act/LeakyRelu_output_0_clone_0 to /model.28/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:21] [V] [TRT] Generating copy for /model.26/conv/_input_quantizer/QuantizeLinear_output_0 to /model.28/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-13:39:21] [V] [TRT] Generating copy for /model.25/conv/_input_quantizer/QuantizeLinear_output_0 to /model.28/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3 to /model.28/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:21] [V] [TRT] Eliminating concatenation /model.20/Concat [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.20/Concat_/model.19/act/LeakyRelu_output_0_clone_0 to /model.21/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:21] [V] [TRT] Generating copy for /model.19/conv/_input_quantizer/QuantizeLinear_output_0 to /model.21/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-13:39:21] [V] [TRT] Generating copy for /model.18/conv/_input_quantizer/QuantizeLinear_output_0 to /model.21/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3 to /model.21/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:21] [V] [TRT] Eliminating concatenation /model.13/Concat [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.13/Concat_/model.12/act/LeakyRelu_output_0_clone_0 to /model.14/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:21] [V] [TRT] Generating copy for /model.12/conv/_input_quantizer/QuantizeLinear_output_0 to /model.14/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-13:39:21] [V] [TRT] Generating copy for /model.11/conv/_input_quantizer/QuantizeLinear_output_0 to /model.14/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3 to /model.14/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:21] [V] [TRT] Eliminating concatenation /model.6/Concat [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.6/Concat_/model.5/act/LeakyRelu_output_0_clone_0 to /model.7/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:21] [V] [TRT] Generating copy for /model.5/conv/_input_quantizer/QuantizeLinear_output_0 to /model.7/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-13:39:21] [V] [TRT] Generating copy for /model.4/conv/_input_quantizer/QuantizeLinear_output_0 to /model.7/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-13:39:21] [V] [TRT] Retargeting /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3 to /model.7/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-13:39:21] [V] [TRT] After concat removal: 135 layers [04/18/2023-13:39:21] [V] [TRT] Trying to split Reshape and strided tensor [04/18/2023-13:39:21] [V] [TRT] Generating copy after /model.77/Reshape_1 [04/18/2023-13:39:21] [V] [TRT] Generating copy after /model.77/Reshape_3 [04/18/2023-13:39:21] [V] [TRT] Generating copy after /model.77/Reshape_5 [04/18/2023-13:39:21] [V] [TRT] Graph construction and optimization completed in 2.09178 seconds. [04/18/2023-13:39:21] [V] [TRT] Trying to load shared library libcublas.so.11 [04/18/2023-13:39:21] [V] [TRT] Loaded shared library libcublas.so.11 [04/18/2023-13:39:21] [V] [TRT] Using cublas as plugin tactic source [04/18/2023-13:39:21] [V] [TRT] Trying to load shared library libcublasLt.so.11 [04/18/2023-13:39:21] [V] [TRT] Loaded shared library libcublasLt.so.11 [04/18/2023-13:39:21] [V] [TRT] Using cublasLt as core library tactic source [04/18/2023-13:39:21] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +6, GPU +10, now: CPU 579, GPU 1212 (MiB) [04/18/2023-13:39:21] [V] [TRT] Trying to load shared library libcudnn.so.8 [04/18/2023-13:39:21] [V] [TRT] Loaded shared library libcudnn.so.8 [04/18/2023-13:39:21] [V] [TRT] Using cuDNN as plugin tactic source [04/18/2023-13:39:21] [V] [TRT] Using cuDNN as core library tactic source [04/18/2023-13:39:21] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +2, GPU +10, now: CPU 581, GPU 1222 (MiB) [04/18/2023-13:39:21] [I] [TRT] Local timing cache in use. Profiling results in this builder pass will not be stored. [04/18/2023-13:39:21] [V] [TRT] Constructing optimization profile number 0 [1/1]. [04/18/2023-13:39:21] [V] [TRT] Reserving memory for host IO tensors. Host: 0 bytes [04/18/2023-13:39:21] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Float(1228800,409600,640,1) -> Int8(409600,409600:4,640,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: /model.0/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0217593 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0142009 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00884518 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00884518 [04/18/2023-13:39:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Float(1228800,409600,640,1) -> Int8(409600,409600:32,640,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: /model.0/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.04346 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0673402 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.03936 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0673402 [04/18/2023-13:39:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:21] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(409600,409600:4,640,1) -> Int8(409600,409600:32,640,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.03643 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.103643 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.035072 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.035072 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(409600,409600:32,640,1) -> Int8(409600,409600:4,640,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0705585 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0512975 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0241044 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0241044 [04/18/2023-13:39:21] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Float(3276800,102400,320,1) -> Float(102400,102400:32,320,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.272384 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0537966 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.279406 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0537966 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Float(3276800,102400,320,1) -> Half(3276800,102400,320,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0331136 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0329143 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0465474 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0329143 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Float(3276800,102400,320,1) -> Half(102400,102400:32,320,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.172325 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.033568 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.169106 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.033568 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Float(102400,102400:32,320,1) -> Float(3276800,102400,320,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.173056 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0536869 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.172763 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0536869 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Float(102400,102400:32,320,1) -> Half(3276800,102400,320,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.163374 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0361326 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.163547 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0361326 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Float(102400,102400:32,320,1) -> Half(102400,102400:32,320,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.35723 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0356681 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.358107 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0356681 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Half(3276800,102400,320,1) -> Float(3276800,102400,320,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0317669 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0368926 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0428983 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0317669 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Half(3276800,102400,320,1) -> Float(102400,102400:32,320,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.270629 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0353134 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.268288 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0353134 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Half(3276800,102400,320,1) -> Half(102400,102400:32,320,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.156137 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0336165 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.153307 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0336165 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Half(102400,102400:32,320,1) -> Float(3276800,102400,320,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.125952 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0362057 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.127543 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0362057 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Half(102400,102400:32,320,1) -> Float(102400,102400:32,320,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.420864 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0374023 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.41589 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0374023 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Half(102400,102400:32,320,1) -> Half(3276800,102400,320,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.104667 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0767291 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.104155 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0767291 [04/18/2023-13:39:21] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(3276800,102400,320,1) -> Int8(819200,102400:4,320,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.1/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0496 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.035944 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0494446 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.035944 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(3276800,102400,320,1) -> Int8(102400,102400:32,320,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.1/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0847474 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0363886 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0847337 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0363886 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(819200,102400:4,320,1) -> Int8(3276800,102400,320,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.1/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0487131 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0447886 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0488 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0447886 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(819200,102400:4,320,1) -> Int8(102400,102400:32,320,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.1/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0629409 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0348453 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0124099 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0124099 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(102400,102400:32,320,1) -> Int8(3276800,102400,320,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.1/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0556023 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0730697 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0554926 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0554926 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(102400,102400:32,320,1) -> Int8(819200,102400:4,320,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.1/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0192869 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0329125 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00980571 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00980571 [04/18/2023-13:39:21] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,25600,160,1) -> Int8(409600,25600:4,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.2/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0256 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0346697 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00845472 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00845472 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,25600,160,1) -> Int8(51200,25600:32,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.2/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0447634 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0186514 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0448 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0186514 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(409600,25600:4,160,1) -> Int8(1638400,25600,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.2/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0257219 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0163352 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0257051 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0163352 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(409600,25600:4,160,1) -> Int8(51200,25600:32,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.2/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0358537 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.016672 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00631453 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00631453 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(51200,25600:32,160,1) -> Int8(1638400,25600,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.2/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0285074 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0396069 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0285067 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0285067 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(51200,25600:32,160,1) -> Int8(409600,25600:4,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.2/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0114402 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0164627 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00558541 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00558541 [04/18/2023-13:39:21] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,25600,160,1) -> Int8(409600,25600:4,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.2/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0255604 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0176142 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00797206 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00797206 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,25600,160,1) -> Int8(51200,25600:32,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.2/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.044784 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.016738 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0447634 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.016738 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(409600,25600:4,160,1) -> Int8(1638400,25600,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.2/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0257021 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0165465 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0256571 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0165465 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(409600,25600:4,160,1) -> Int8(51200,25600:32,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.2/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.035872 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0170961 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00636661 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00636661 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(51200,25600:32,160,1) -> Int8(1638400,25600,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.2/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0285044 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0395703 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.028528 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0285044 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(51200,25600:32,160,1) -> Int8(409600,25600:4,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.2/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0114729 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0164952 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00555305 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00555305 [04/18/2023-13:39:21] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(3276800,25600,160,1) long-strided -> Int8(819200,25600:4,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0143099 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0165318 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00519837 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00519837 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(3276800,25600,160,1) long-strided -> Int8(102400,25600:32,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0213995 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0149102 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0213714 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0149102 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600:4,160,1) long-strided -> Int8(3276800,25600,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0126453 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0132177 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0126724 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0126453 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600:4,160,1) long-strided -> Int8(102400,25600:32,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0186103 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0131898 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00407428 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00407428 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(102400,25600:32,160,1) long-strided -> Int8(3276800,25600,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0142309 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0205832 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0142292 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0142292 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(102400,25600:32,160,1) long-strided -> Int8(819200,25600:4,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00687434 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108519 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00400825 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00400825 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00402768 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0129303 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00402286 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00402286 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0125691 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00817956 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00478202 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00478202 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.021393 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00817778 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.021391 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00817778 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0126396 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121821 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0125787 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0121821 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00536093 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00876719 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00669756 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00536093 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0186314 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00889573 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0037392 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0037392 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0142176 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0210723 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0142508 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0142176 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00683059 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00872255 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00401511 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00401511 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0201349 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00654712 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00353985 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00353985 [04/18/2023-13:39:21] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,25600,160,1) -> Int8(409600,25600:4,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,25600,160,1) -> Int8(51200,25600:32,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(409600,25600:4,160,1) -> Int8(1638400,25600,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(409600,25600:4,160,1) -> Int8(51200,25600:32,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(51200,25600:32,160,1) -> Int8(1638400,25600,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(51200,25600:32,160,1) -> Int8(409600,25600:4,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(204800,25600:4,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.4/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.012563 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00783735 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00475207 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00475207 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.4/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0213597 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00814349 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0213623 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00814349 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(819200,25600,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.4/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0126331 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012112 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0125928 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.012112 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.4/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0186829 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00879812 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0037467 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0037467 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(819200,25600,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.4/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0142479 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0205447 [04/18/2023-13:39:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.01424 [04/18/2023-13:39:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.01424 [04/18/2023-13:39:21] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(204800,25600:4,160,1) *************** [04/18/2023-13:39:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.4/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00683385 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00872739 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00401168 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00401168 [04/18/2023-13:39:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(204800,25600:4,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.4/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0125619 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00780487 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00478903 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00478903 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.4/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0213995 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00811886 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0213864 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00811886 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(819200,25600,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.4/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0126476 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012109 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.012587 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.012109 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.4/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0185457 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00876854 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00371645 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00371645 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(819200,25600,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.4/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0142429 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0205388 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0141797 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0141797 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(204800,25600:4,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.4/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00684452 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00870427 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00401638 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00401638 [04/18/2023-13:39:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(204800,25600:4,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(819200,25600,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(819200,25600,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(204800,25600:4,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(204800,25600:4,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(819200,25600,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(819200,25600,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(204800,25600:4,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(3276800,25600,160,1) long-strided -> Int8(819200,25600:4,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(3276800,25600,160,1) long-strided -> Int8(102400,25600:32,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600:4,160,1) long-strided -> Int8(3276800,25600,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600:4,160,1) long-strided -> Int8(102400,25600:32,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,25600:32,160,1) long-strided -> Int8(3276800,25600,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,25600:32,160,1) long-strided -> Int8(819200,25600:4,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.5/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00402603 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0128907 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00401549 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00401549 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.5/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0125714 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00779645 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00473335 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00473335 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.5/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0213401 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00811784 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0213433 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00811784 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.5/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0126194 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121592 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.012547 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0121592 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.5/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00535026 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00873224 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00670421 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00535026 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.5/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0185566 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00877741 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00375467 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00375467 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.5/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.014245 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0207223 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0142458 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.014245 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.5/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0068184 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00869324 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00403644 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00403644 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.5/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.020184 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00657808 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00356047 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00356047 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.4/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00401067 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0128625 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00401714 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00401067 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.4/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0126084 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00779982 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00475193 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00475193 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.4/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0213995 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00810641 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0214126 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00810641 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.4/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0126248 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121619 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.012603 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0121619 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.4/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0054505 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00872336 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00669423 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0054505 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.4/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0186851 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00878602 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00378117 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00378117 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.4/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0142429 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0209247 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0142885 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0142429 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.4/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00683603 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0086685 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00404241 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00404241 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.4/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0201897 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00658369 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00353873 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00353873 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(3276800,25600,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.7/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0444811 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0215654 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0163261 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0163261 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(3276800,25600,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.7/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0774743 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0213068 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0774583 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0213068 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600:4,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.7/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0438126 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0235376 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0438834 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0235376 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600:4,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.7/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0590019 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0247954 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0131923 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0131923 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,25600:32,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.7/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.048128 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0648091 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0478781 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0478781 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,25600:32,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.7/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0172922 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0249638 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00806654 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00806654 [04/18/2023-13:39:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,25600,160,1) -> Int8(409600,25600:4,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,25600,160,1) -> Int8(51200,25600:32,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,25600:4,160,1) -> Int8(51200,25600:32,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(51200,25600:32,160,1) -> Int8(409600,25600:4,160,1) *************** [04/18/2023-13:39:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.9/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0075775 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00719932 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00772427 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00719932 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.9/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0117046 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603695 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00309729 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00309729 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.9/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00901257 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0129341 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.008996 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.008996 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.9/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00517616 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597162 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00337233 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00337233 [04/18/2023-13:39:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.9/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00758015 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630559 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00364652 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00364652 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.9/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0125143 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00627101 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0124716 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00627101 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.9/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00757799 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00718674 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00758713 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00718674 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.9/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0116325 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596229 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00308357 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00308357 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.9/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00891294 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012784 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00893514 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00891294 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.9/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00512979 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590994 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00335415 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00335415 [04/18/2023-13:39:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,6400,80,1) long-strided -> Int8(409600,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00750331 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00628035 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00364446 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00364446 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,6400,80,1) long-strided -> Int8(51200,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0123672 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617752 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0124042 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00617752 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400:4,80,1) long-strided -> Int8(1638400,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00754502 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00716046 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0075265 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00716046 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400:4,80,1) long-strided -> Int8(51200,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0115534 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591287 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00309135 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00309135 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:32,80,1) long-strided -> Int8(1638400,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00893057 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130327 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00894029 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00893057 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:32,80,1) long-strided -> Int8(409600,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00510547 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589275 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00336425 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00336425 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(1638400,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00324429 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00867281 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00324886 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00324429 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00751063 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00632964 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00360857 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00360857 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0124221 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631493 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.012395 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00631493 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(1638400,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0075277 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00712729 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00757365 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00712729 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00396219 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582181 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00442459 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00396219 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0115415 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598362 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00308114 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00308114 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(1638400,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00894971 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0128312 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.008942 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.008942 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00512326 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599619 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00335001 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00335001 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0123371 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604095 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00295921 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00295921 [04/18/2023-13:39:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.11/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00750057 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626405 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00360274 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00360274 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.11/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0124019 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00635548 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0123947 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00635548 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,6400,80,1) long-strided -> Int8(409600,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,6400,80,1) long-strided -> Int8(51200,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400:4,80,1) long-strided -> Int8(1638400,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400:4,80,1) long-strided -> Int8(51200,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:32,80,1) long-strided -> Int8(1638400,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:32,80,1) long-strided -> Int8(409600,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(1638400,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(1638400,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(1638400,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(1638400,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.12/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325278 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0086556 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00323403 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00323403 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.12/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00751383 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630002 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00360069 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00360069 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.12/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0123764 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00620362 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0124091 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00620362 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(1638400,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.12/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00755657 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.007136 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00753035 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.007136 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.12/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00395268 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586368 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00443027 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00395268 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.12/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0116765 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592439 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00306568 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00306568 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(1638400,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.12/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00897086 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0128564 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00894429 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00894429 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.12/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00512163 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059478 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00335171 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00335171 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.12/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0124312 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585948 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00295519 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00295519 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(1638400,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.11/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00324236 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00872686 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00323891 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00323891 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.11/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00750286 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00625848 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00361314 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00361314 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.11/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0123741 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621913 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0124065 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00621913 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(1638400,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.11/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00751337 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00716137 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00749257 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00716137 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.11/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00397308 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586076 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00443706 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00397308 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.11/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0115791 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059381 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00307258 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00307258 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(1638400,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.11/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00891993 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130585 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00893499 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00891993 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.11/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00510629 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589458 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00332073 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00332073 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.11/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0123516 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595752 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00293999 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00293999 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,6400,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.022671 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120088 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00697578 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00697578 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,6400,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0406309 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121474 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0405474 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0121474 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400:4,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0334702 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0134629 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00795886 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00795886 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:32,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0103102 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0133191 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0049056 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0049056 [04/18/2023-13:39:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Float(204800,1:4,2560,32) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.016738 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010208 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0168112 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.010208 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Float(25600,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0324855 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100645 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0324754 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0100645 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Half(819200,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00403543 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00893457 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0114978 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00403543 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Half(409600,6400:2,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00988069 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114687 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00616076 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00616076 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Half(102400,1:8,1280,16) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0156503 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00746788 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00708659 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00708659 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Half(25600,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.024013 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00806806 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.024045 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00806806 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Float(819200,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0138444 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012176 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0137745 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.012176 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Float(204800,1:4,2560,32) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0128164 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00922429 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0128118 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00922429 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Half(819200,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0133486 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00924486 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0133311 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00924486 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Half(409600,6400:2,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0142579 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112819 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0143401 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0112819 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Half(102400,1:8,1280,16) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0117813 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00707962 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0117894 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00707962 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Half(25600,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0319195 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00712163 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0319141 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00712163 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Float(819200,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0128998 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00890918 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0129227 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00890918 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Float(204800,1:4,2560,32) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0119531 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00709464 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0119589 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00709464 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Float(25600,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0354715 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00814984 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0354889 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00814984 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Half(819200,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.012784 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0200617 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0127973 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.012784 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Half(409600,6400:2,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00791002 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011053 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00789895 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00789895 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Half(102400,1:8,1280,16) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0112974 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00717943 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0112844 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00717943 [04/18/2023-13:39:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Float(204800,1:4,2560,32) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0168371 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100632 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0167055 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0100632 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Half(819200,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00403708 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00896686 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0115362 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00403708 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Half(409600,6400:2,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00985204 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114402 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00616609 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00616609 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Half(102400,1:8,1280,16) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0156759 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00748114 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00709747 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00709747 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(204800,1:4,2560,32) -> Float(819200,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0137642 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120088 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0136569 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0120088 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(204800,1:4,2560,32) -> Half(819200,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0132605 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00871153 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0131969 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00871153 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(204800,1:4,2560,32) -> Half(409600,6400:2,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0138705 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112679 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0139682 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0112679 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(204800,1:4,2560,32) -> Half(102400,1:8,1280,16) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0117996 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00708201 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0118073 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00708201 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Float(819200,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0138107 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121749 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0138128 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0121749 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Float(204800,1:4,2560,32) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0128766 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00925314 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0128419 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00925314 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Half(819200,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0133253 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00920314 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.013393 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00920314 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Half(409600,6400:2,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0140675 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113393 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0140006 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0113393 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Half(102400,1:8,1280,16) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0118059 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00707679 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0117746 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00707679 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400,80,1) -> Float(819200,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00408607 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00906057 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0110277 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00408607 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400,80,1) -> Float(204800,1:4,2560,32) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0158053 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00751726 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0157842 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00751726 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400,80,1) -> Half(409600,6400:2,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00940486 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00773606 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00617428 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00617428 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400,80,1) -> Half(102400,1:8,1280,16) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0150048 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00695205 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00674847 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00674847 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(409600,6400:2,80,1) -> Float(819200,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0100407 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00934114 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00606629 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00606629 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(409600,6400:2,80,1) -> Float(204800,1:4,2560,32) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0123855 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00780367 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0123707 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00780367 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(409600,6400:2,80,1) -> Half(819200,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00940943 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.023392 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00605086 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00605086 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(409600,6400:2,80,1) -> Half(102400,1:8,1280,16) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0116188 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00775988 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00500177 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00500177 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:8,1280,16) -> Float(819200,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0129863 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00900629 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00574994 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00574994 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:8,1280,16) -> Float(204800,1:4,2560,32) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0119223 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00757173 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0119577 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00757173 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:8,1280,16) -> Half(819200,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0127585 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0202503 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00524065 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00524065 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:8,1280,16) -> Half(409600,6400:2,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0132991 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111068 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00486735 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00486735 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Float(819200,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0128731 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00891429 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0129116 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00891429 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Float(204800,1:4,2560,32) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0119589 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0071188 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0119436 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0071188 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Half(819200,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0128 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0200229 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0127859 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0127859 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Half(409600,6400:2,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00789678 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109672 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00788596 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00788596 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Half(102400,1:8,1280,16) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0112925 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00721303 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0112826 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00721303 [04/18/2023-13:39:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Float(51200,1:4,1280,32) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00550646 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592622 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00552932 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00550646 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00258596 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00654608 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004448 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00258596 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0041041 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588581 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00309573 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00309573 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Half(25600,1:8,640,16) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00540106 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058955 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00299714 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00299714 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(51200,1:4,1280,32) -> Float(204800,1600,40,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00550084 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00655273 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00549486 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00549486 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(51200,1:4,1280,32) -> Half(204800,1600,40,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00544085 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587776 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00544711 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00544085 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(51200,1:4,1280,32) -> Half(102400,1600:2,40,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0055622 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599095 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00553354 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00553354 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(51200,1:4,1280,32) -> Half(25600,1:8,640,16) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00463366 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615752 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00462688 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00462688 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251966 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611448 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00420813 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00251966 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600,40,1) -> Float(51200,1:4,1280,32) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00538396 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589861 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00537227 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00537227 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00399721 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599067 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00309914 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00309914 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600,40,1) -> Half(25600,1:8,640,16) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00515853 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596305 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00293616 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00293616 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(102400,1600:2,40,1) -> Float(204800,1600,40,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00414864 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00574043 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00309427 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00309427 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(102400,1600:2,40,1) -> Float(51200,1:4,1280,32) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00478949 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586057 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0047936 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00478949 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(102400,1600:2,40,1) -> Half(204800,1600,40,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00396952 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.009076 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00308036 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00308036 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(102400,1600:2,40,1) -> Half(25600,1:8,640,16) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00460386 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587301 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00260846 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00260846 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:8,640,16) -> Float(204800,1600,40,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00535856 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00579346 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00281017 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00281017 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:8,640,16) -> Float(51200,1:4,1280,32) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00465681 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596343 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00465327 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00465327 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:8,640,16) -> Half(204800,1600,40,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00525551 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00824864 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00263156 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00263156 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:8,640,16) -> Half(102400,1600:2,40,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00535111 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585765 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251381 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251381 [04/18/2023-13:39:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00515935 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00828495 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00516506 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00515935 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0110428 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00710487 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00383447 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00383447 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0208856 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0070228 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.020894 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0070228 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(204800,1:4,2560,32) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0133714 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0087083 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0134292 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0087083 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(204800,1:4,2560,32) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0147621 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00845042 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0147017 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00845042 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(204800,1:4,2560,32) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0289061 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0084636 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0288183 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0084636 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0135057 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00864027 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.013514 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00864027 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.01448 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00758713 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0149975 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00758713 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0285554 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00758592 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0286318 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00758592 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00412395 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00920171 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00411807 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00411807 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0113284 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00857089 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0112823 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00857089 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0208372 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00703042 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0208163 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00703042 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(409600,6400:2,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0114198 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0135655 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0114138 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0114138 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(409600,6400:2,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00708201 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00883254 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00706917 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00706917 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(409600,6400:2,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0119265 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00738308 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0119375 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00738308 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:8,1280,16) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0137895 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0123771 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0138485 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0123771 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:8,1280,16) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0145262 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00811683 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0142828 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00811683 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:8,1280,16) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0287415 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00635448 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0287113 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00635448 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0132073 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0205845 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0131798 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0131798 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00852894 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00812038 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00851899 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00812038 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0137097 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00636283 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.013738 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00636283 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00293635 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0991177 [04/18/2023-13:39:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00293196 [04/18/2023-13:39:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00293196 [04/18/2023-13:39:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:22] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:22] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00446074 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058251 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265405 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00265405 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00733623 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00581285 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00734903 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00581285 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(51200,1:4,1280,32) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00552281 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598781 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0054698 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0054698 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(51200,1:4,1280,32) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00591543 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00641192 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00589952 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00589952 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(51200,1:4,1280,32) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.009278 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00646002 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00925657 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00646002 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00278611 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0724114 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0027862 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00278611 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00459914 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584521 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00460071 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00459914 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00763765 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584174 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00760253 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00584174 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(102400,1600:2,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00460859 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675491 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00463322 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00460859 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(102400,1600:2,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00355624 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00581321 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00357107 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00355624 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(102400,1600:2,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00516669 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00581193 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00530269 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00516669 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:8,640,16) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00573257 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00642306 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00574537 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00573257 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:8,640,16) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00573147 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00575927 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00574866 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00573147 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:8,640,16) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00936886 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595276 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00939657 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00595276 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00300438 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0991566 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0029314 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0029314 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00446443 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586149 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00264254 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00264254 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00733577 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591726 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00733851 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00591726 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(51200,1:4,1280,32) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00550031 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00578048 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00562743 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00550031 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(51200,1:4,1280,32) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00588654 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00642365 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00592073 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00588654 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(51200,1:4,1280,32) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00927029 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00641769 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.009262 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00641769 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00277442 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0724846 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00279165 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00277442 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00458929 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583387 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00458643 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00458643 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0075994 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589404 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00761119 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00589404 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(102400,1600:2,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00464782 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675242 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00461537 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00461537 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(102400,1600:2,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00356248 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00578469 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00357474 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00356248 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(102400,1600:2,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00516849 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585856 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00515641 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00515641 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:8,640,16) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00573733 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00642981 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00574903 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00573733 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:8,640,16) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00572343 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00581266 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00572526 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00572343 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:8,640,16) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00939086 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583644 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00939714 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00583644 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.50/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0126552 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00777576 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00470548 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00470548 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.50/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0216431 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00813384 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0216699 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00813384 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.50/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0127185 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00895771 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0126396 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00895771 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.50/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0189274 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00879543 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00484069 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00484069 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.50/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0142608 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0202983 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0142903 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0142608 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.50/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00688501 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00862413 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00401282 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00401282 [04/18/2023-13:39:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) long-strided -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00752842 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626087 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00360606 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00360606 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) long-strided -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0124198 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629088 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0124221 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00629088 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) long-strided -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00752842 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00712577 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00754959 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00712577 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) long-strided -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.011641 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596457 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00308211 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00308211 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) long-strided -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00892316 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0128297 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00895029 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00892316 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) long-strided -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00511673 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587026 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334501 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00334501 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325091 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00877983 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00324155 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00324155 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.007512 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062716 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00361051 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00361051 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0124137 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631672 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0123676 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00631672 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00754983 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00715314 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00749874 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00715314 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00396219 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00581559 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00442542 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00396219 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.011546 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604419 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00309602 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00309602 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00890783 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012829 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00890971 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00890783 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00512343 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584101 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334607 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00334607 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0123219 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599886 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00293943 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00293943 [04/18/2023-13:39:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.16/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00515559 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586533 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00286007 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00286007 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.16/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00781233 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.005976 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00778202 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.005976 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.16/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00513306 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616419 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00513959 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00513306 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.16/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00766099 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586441 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00303429 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00303429 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.16/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0061059 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00860719 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.006088 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.006088 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.16/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00399784 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058805 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283671 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00283671 [04/18/2023-13:39:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,1600,40,1) long-strided -> Int8(204800,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00513829 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00581339 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00284836 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00284836 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,1600,40,1) long-strided -> Int8(25600,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00779741 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596476 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00776878 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00596476 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600:4,40,1) long-strided -> Int8(819200,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00513404 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614514 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00513437 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00513404 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600:4,40,1) long-strided -> Int8(25600,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00770983 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589477 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00302752 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00302752 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:32,40,1) long-strided -> Int8(819200,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00605886 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00861876 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00605429 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00605429 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:32,40,1) long-strided -> Int8(204800,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00399898 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587191 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0028558 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0028558 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(819200,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00295361 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00678442 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00294913 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00294913 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00514269 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583918 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00287543 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00287543 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0076954 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600095 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00768601 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00600095 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(819200,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00513567 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614343 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00515543 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00513567 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00317088 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582949 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00327823 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00317088 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00752722 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592805 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00302247 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00302247 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(819200,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00607657 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0086997 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00606933 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00606933 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00399505 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593701 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00284827 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00284827 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00801372 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603371 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00264965 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00264965 [04/18/2023-13:39:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.18/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00514612 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583991 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00286674 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00286674 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.18/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00779549 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593792 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00780559 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00593792 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.18/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00512049 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0061459 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00513975 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00512049 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.18/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00765425 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591049 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00301543 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00301543 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.18/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00605714 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00859321 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00607162 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00605714 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.18/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00399568 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591049 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283895 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00283895 [04/18/2023-13:39:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,1600,40,1) long-strided -> Int8(204800,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,1600,40,1) long-strided -> Int8(25600,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600:4,40,1) long-strided -> Int8(819200,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600:4,40,1) long-strided -> Int8(25600,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:32,40,1) long-strided -> Int8(819200,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:32,40,1) long-strided -> Int8(204800,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(819200,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(819200,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(819200,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(819200,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.19/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0029704 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00679543 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00295725 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00295725 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.19/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00513012 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582693 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0028558 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0028558 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.19/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00792445 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598876 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00792758 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00598876 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(819200,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.19/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00512751 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616343 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00513584 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00512751 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.19/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0031682 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00577335 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00326888 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0031682 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.19/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00806857 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594469 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00299609 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00299609 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(819200,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.19/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0060859 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0086279 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00609886 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0060859 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.19/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00400368 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586715 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283706 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00283706 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.19/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00834438 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058421 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265905 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00265905 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(819200,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.18/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0029649 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677507 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00295631 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00295631 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.18/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00512473 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00576859 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0028445 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0028445 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.18/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00789943 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613867 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00790592 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00613867 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(819200,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.18/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00513077 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615752 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00512653 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00512653 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.18/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00317456 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00581979 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00329621 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00317456 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.18/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00762346 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607048 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00301828 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00301828 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(819200,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.18/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00613276 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00862279 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00605657 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00605657 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.18/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00400584 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593829 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00286171 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00286171 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: /model.18/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00810311 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593445 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265752 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00265752 [04/18/2023-13:39:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,1600,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0127467 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00776469 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00482484 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00482484 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,1600,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0217757 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00774568 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0217319 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00774568 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600:4,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.01896 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.009238 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0057069 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0057069 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:32,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00692506 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00859617 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00391425 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00391425 [04/18/2023-13:39:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0101425 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00635906 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0102126 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00635906 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0175523 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00636403 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.017473 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00636403 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Half(409600,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00307783 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00655418 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00665164 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00307783 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00604743 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00778009 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00413766 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00413766 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00992 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00571831 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00443498 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00443498 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.013354 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591909 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0133623 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00591909 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00834464 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0073872 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00833803 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0073872 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00703412 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591781 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00702411 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00591781 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(409600,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00827225 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00662587 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00824381 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00662587 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00858541 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00779645 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00857654 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00779645 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00703108 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00575653 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00704631 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00575653 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0172587 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584704 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0172455 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00584704 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00792421 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00668821 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00793905 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00668821 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00708484 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00719474 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00709399 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00708484 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0195051 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585125 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0193754 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00585125 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(409600,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00784866 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012728 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00783759 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00783759 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00529219 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00768048 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00530269 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00529219 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00674099 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582949 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00678151 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00582949 [04/18/2023-13:39:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0101961 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00641192 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0102077 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00641192 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Half(409600,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00307346 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00652613 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00664707 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00307346 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00605867 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00778779 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00411833 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00411833 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00991512 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00581285 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00442279 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00442279 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Float(409600,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00848618 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00730766 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00851469 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00730766 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(409600,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0083708 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00646678 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00833194 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00646678 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00882931 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00773245 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00883576 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00773245 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00703412 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589842 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0070265 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00589842 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00835225 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00739314 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00834946 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00739314 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00702411 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587685 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00702455 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00587685 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(409600,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00825473 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00662982 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00831467 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00662982 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00858703 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00781017 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00864726 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00781017 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00703913 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00577335 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00703499 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00577335 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(409600,1600,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00306383 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00665226 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00648845 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00306383 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(409600,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00997577 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586021 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00996358 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00586021 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(409600,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00575415 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.005871 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00412016 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00412016 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(409600,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00955551 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584064 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00427119 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00427119 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00618971 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00655896 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00412447 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00412447 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0075088 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00572526 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00750788 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00572526 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(409600,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0057995 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0143525 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409731 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00409731 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00720549 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00578706 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00340495 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00340495 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Float(409600,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00820241 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00664353 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00398006 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00398006 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00706547 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584064 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00705937 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00584064 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(409600,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00789077 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0127086 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0035728 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0035728 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0082753 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00769323 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00337669 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00337669 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00791386 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0066774 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00794133 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0066774 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00707113 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00573751 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00709225 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00573751 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(409600,1600,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00784674 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0127204 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00782773 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00782773 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00531369 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00767519 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00531488 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00531369 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00678919 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00580955 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00677236 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00580955 [04/18/2023-13:39:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00436793 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595543 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00434826 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00434826 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Half(102400,400,20,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00231204 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0208712 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00353918 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00231204 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00319472 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582967 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00263763 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00263763 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00436461 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591086 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00289911 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00289911 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Float(102400,400,20,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00405397 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00636025 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00403479 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00403479 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(102400,400,20,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00406222 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584247 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00405232 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00405232 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00411193 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00581778 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0041246 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00411193 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00340735 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596229 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00339487 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00339487 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(102400,400,20,1) -> Float(102400,400,20,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00223058 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0207334 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00316581 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00223058 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(102400,400,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00427738 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591799 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00428276 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00427738 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(102400,400,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00310668 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595448 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00263871 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00263871 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(102400,400,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00424094 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586935 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00285499 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00285499 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Float(102400,400,20,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00323809 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00576786 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00259502 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00259502 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00355635 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582802 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00359749 [04/18/2023-13:39:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00355635 [04/18/2023-13:39:23] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(102400,400,20,1) *************** [04/18/2023-13:39:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00310986 [04/18/2023-13:39:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00635687 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00260513 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00260513 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00348889 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582382 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250723 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250723 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Float(102400,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00420598 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00573989 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00263198 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00263198 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00345459 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631911 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346231 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00345459 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(102400,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00414419 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060261 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254564 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00254564 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00428719 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585874 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238438 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238438 [04/18/2023-13:39:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00370016 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.193975 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0037508 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00370016 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00665642 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00581486 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00297329 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00297329 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0121051 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062881 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0119143 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0062881 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00891106 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00651553 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00893771 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00651553 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0095747 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00719726 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00960488 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00719726 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0171617 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0070831 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0172094 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0070831 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00856175 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00643578 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00850151 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00643578 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00905571 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612705 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00905486 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00612705 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0156759 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0061259 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.015669 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0061259 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(409600,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00318568 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.141605 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0034092 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00318568 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(409600,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00685976 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062877 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00686716 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0062877 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(409600,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0118481 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585344 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0118287 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00585344 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00692898 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00877768 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00692572 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00692572 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00473659 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00637297 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00472568 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00472568 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00731886 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583442 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00731771 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00583442 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00879892 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00844612 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00874918 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00844612 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.009074 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607181 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00909514 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00607181 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.015669 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591342 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0156649 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00591342 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00834514 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0129912 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00837994 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00834514 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00581943 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606933 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00582345 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00581943 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00825676 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588855 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00827048 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00588855 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00263996 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.053053 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00264603 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00263996 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00343042 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00580846 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237834 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237834 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00510939 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588672 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00511396 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00510939 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00434396 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058379 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0044124 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00434396 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0044408 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626107 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0044462 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0044408 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00639801 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603314 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00639722 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00603314 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(102400,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025999 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.039056 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00259396 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00259396 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0035394 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592768 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0035491 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0035394 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00524065 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587685 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00524131 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00524065 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00352022 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0057984 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00352413 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00352022 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00295865 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587173 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00294083 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00294083 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00386854 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591616 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00385564 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00385564 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00431207 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00576658 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00433219 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00431207 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00437416 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590007 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00438746 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00437416 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00600705 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582766 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00603314 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00582766 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00263514 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0530682 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00262924 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00262924 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342302 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582491 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023853 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0023853 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00511673 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588434 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00510971 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00510971 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00436585 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584613 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00439217 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00436585 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00445105 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610724 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00444828 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00444828 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00638231 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604476 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00639404 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00604476 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(102400,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00261153 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0390583 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00260979 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00260979 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00353851 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587703 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00354486 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00353851 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00523477 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586386 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00522628 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00522628 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00352892 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00564466 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0035355 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00352892 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00298438 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0057408 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00300228 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00298438 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00383952 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586569 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00384866 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00383952 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00432807 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0056487 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00432134 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00432134 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.004439 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0056793 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00440949 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00440949 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00600667 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583643 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00599162 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00583643 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.40/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00767254 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00624219 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00370989 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00370989 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.40/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0126617 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593609 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0126785 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00593609 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.40/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00766628 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0070461 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0076966 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0070461 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.40/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0119592 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589879 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00389041 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00389041 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.40/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00894886 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0123463 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00896114 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00894886 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.40/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00505631 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588818 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00326493 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00326493 [04/18/2023-13:39:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) long-strided -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00511494 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590153 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00284701 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00284701 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) long-strided -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00797384 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598152 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00793817 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00598152 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) long-strided -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00513535 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615467 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00513469 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00513469 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) long-strided -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0080701 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590043 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00301219 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00301219 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) long-strided -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00607086 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0086322 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00608305 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00607086 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) long-strided -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00399505 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593554 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00284728 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00284728 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00302009 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00680642 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00295016 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00295016 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00514449 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587758 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283868 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00283868 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00782268 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607867 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00779429 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00607867 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00513682 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615047 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00512833 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00512833 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00317297 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00581541 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0032614 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00317297 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00764198 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587264 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00303438 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00303438 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00609219 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00860289 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00605486 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00605486 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00400622 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593317 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00284468 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00284468 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00811759 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585234 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265456 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00265456 [04/18/2023-13:39:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.23/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00391784 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00580462 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00281188 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00281188 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.23/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00546658 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597314 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00546421 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00546421 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.23/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00383711 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583442 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00384974 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00383711 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.23/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00532775 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587922 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00294344 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00294344 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.23/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00448271 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00708463 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00448529 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00448271 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.23/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344686 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587282 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00259347 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00259347 [04/18/2023-13:39:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(409600,400,20,1) long-strided -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00388201 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587081 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00276993 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00276993 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(409600,400,20,1) long-strided -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00571849 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00625471 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00571922 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00571849 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) long-strided -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00385335 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588398 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0038572 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00385335 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) long-strided -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00531251 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592914 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00295622 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00295622 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) long-strided -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00449843 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0069403 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004466 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.004466 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) long-strided -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342389 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589586 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00256735 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00256735 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00277794 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0416594 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00277029 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00277029 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00387583 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584411 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00277829 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00277829 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0055476 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059211 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00551947 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00551947 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00389461 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582802 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00384818 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00384818 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00295846 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593225 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272155 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00272155 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00544982 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606191 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00295743 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00295743 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00448529 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00688218 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00486979 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00448529 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034203 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610724 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255543 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00255543 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00544796 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584978 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00273389 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00273389 [04/18/2023-13:39:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.25/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00388942 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00575579 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00277029 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00277029 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.25/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00548148 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059264 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00546777 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00546777 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.25/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00385805 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582711 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00384926 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00384926 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.25/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00533045 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00577628 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00296061 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00296061 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.25/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00449014 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00697861 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00449171 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00449014 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.25/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.003408 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585911 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00258188 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00258188 [04/18/2023-13:39:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(409600,400,20,1) long-strided -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(409600,400,20,1) long-strided -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) long-strided -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) long-strided -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) long-strided -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) long-strided -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.26/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0027731 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.041632 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00277477 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0027731 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.26/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00396343 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00579182 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00287698 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00287698 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.26/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00559578 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591634 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00559297 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00559297 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.26/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00386162 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601829 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00386916 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00386162 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.26/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00298962 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584503 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0028715 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0028715 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.26/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00565855 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584009 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00293933 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00293933 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.26/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00450129 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00693616 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004484 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.004484 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.26/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00341747 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583808 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255478 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00255478 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.26/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00543052 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00577609 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00273156 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00273156 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.25/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00277433 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0416914 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00278189 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00277433 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.25/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038909 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584027 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00275578 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00275578 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.25/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00568492 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606686 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00567596 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00567596 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.25/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00391067 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00577737 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00385708 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00385708 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.25/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00295324 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583991 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270637 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00270637 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.25/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00534197 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586972 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0029314 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0029314 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.25/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00447457 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00693856 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00447286 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00447286 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.25/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00340789 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591945 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255046 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00255046 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: /model.25/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0054989 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590299 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0027363 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0027363 [04/18/2023-13:39:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(409600,400,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.28/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00768481 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00656332 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00384144 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00384144 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(409600,400,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.28/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0127973 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630897 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.012856 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00630897 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.28/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00770671 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00758159 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00769227 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00758159 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.28/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0115415 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609352 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00422171 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00422171 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.28/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00927057 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0145481 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00929972 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00927057 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.28/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00514449 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596718 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00364743 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00364743 [04/18/2023-13:39:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.29/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00513959 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600057 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00293644 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00293644 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.29/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00798019 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609905 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00795302 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00609905 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.29/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00513633 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00646658 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00515837 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00513633 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.29/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00749531 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597314 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00339795 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00339795 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.29/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0060979 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100288 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00607886 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00607886 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.29/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00396022 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595467 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00299552 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00299552 [04/18/2023-13:39:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.29/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00516114 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599657 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00293737 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00293737 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.29/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00795708 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606933 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00795556 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00606933 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.29/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00514906 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00646917 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00515967 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00514906 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.29/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00752962 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00623333 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0033887 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0033887 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.29/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00609847 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100148 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00611181 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00609847 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.29/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00396293 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588855 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00297933 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00297933 [04/18/2023-13:39:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) long-strided -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00389053 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583808 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00281125 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00281125 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) long-strided -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0056807 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602172 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00567543 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00567543 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) long-strided -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038542 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584284 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0038388 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0038388 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) long-strided -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00535517 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591031 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00292515 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00292515 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) long-strided -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00448371 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00690721 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00446786 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00446786 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) long-strided -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342933 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594377 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255927 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00255927 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00277152 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.041728 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00277785 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00277152 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00388176 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595543 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00277811 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00277811 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00559402 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615505 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0055949 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00559402 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00387188 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587685 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00384746 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00384746 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00296126 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585417 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268868 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00268868 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0056633 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589659 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00293868 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00293868 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00447771 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00704762 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00447286 [04/18/2023-13:39:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00447286 [04/18/2023-13:39:24] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342052 [04/18/2023-13:39:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595276 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00259674 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00259674 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00542273 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591214 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00276053 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00276053 [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) long-strided -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) long-strided -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) long-strided -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) long-strided -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) long-strided -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) long-strided -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) long-strided -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) long-strided -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) long-strided -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) long-strided -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) long-strided -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) long-strided -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00278207 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0416914 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00291825 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00278207 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00389263 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596419 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00277301 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00277301 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00554901 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593993 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00555868 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00554901 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00385023 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582601 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00383832 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00383832 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00296228 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588727 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270715 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00270715 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00543255 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058421 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00295771 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00295771 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00446814 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00693268 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004495 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00446814 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00341605 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590263 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253738 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00253738 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00542781 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584448 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00275024 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00275024 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(409600,400,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(409600,400,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) long-strided -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) long-strided -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) long-strided -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) long-strided -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) long-strided -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) long-strided -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) long-strided -> Float(6400,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00623563 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597771 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00626385 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00597771 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) long-strided -> Half(6400,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00521355 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058443 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00521224 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00521224 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) long-strided -> Float(204800,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00402895 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00636045 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00400965 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00400965 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) long-strided -> Half(6400,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00626425 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596591 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00625888 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00596591 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) long-strided -> Float(204800,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00405892 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00573568 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00405879 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00405879 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) long-strided -> Float(6400,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0068763 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00580846 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00686171 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00580846 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Float(204800,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00228165 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583205 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00230879 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00228165 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Float(6400,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00625133 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598762 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00628313 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00598762 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Half(6400,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00520196 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00570708 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00522628 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00520196 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Float(204800,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00403124 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00634077 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00400762 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00400762 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Float(6400,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00728137 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0057845 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236036 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236036 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(6400,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0062712 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00575671 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00629346 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00575671 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(204800,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0040626 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00568721 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00406235 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00406235 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(6400,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00687412 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00572398 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00688544 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00572398 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(6400,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00391784 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586679 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235908 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235908 [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.38/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0026255 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.053053 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265135 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0026255 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.38/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034203 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591433 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00340441 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00340441 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.38/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00516114 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582876 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00506593 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00506593 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.38/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00415961 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00580443 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00415987 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00415961 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.38/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00426205 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00580114 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00416366 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00416366 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.38/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00595372 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00572965 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00596419 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00572965 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.38/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00437555 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00652945 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00436987 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00436987 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.38/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00356148 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585106 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00358114 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00356148 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.38/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00436211 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587118 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00436585 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00436211 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.39/Resize_output_0 -> ) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00428518 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595543 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00427213 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00427213 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.39/Resize_output_0 -> ) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00312149 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584137 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00311513 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00311513 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.39/Resize_output_0 -> ) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0042841 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587228 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249773 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249773 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.39/Resize_output_0 -> ) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00376758 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059741 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00376205 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00376205 [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.41/Concat_/model.39/Resize_output_0_clone_1 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00294456 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676239 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00295585 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00294456 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.41/Concat_/model.39/Resize_output_0_clone_1 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00512326 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586002 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00290231 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00290231 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.41/Concat_/model.39/Resize_output_0_clone_1 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00794032 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593189 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00794667 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00593189 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.41/Concat_/model.39/Resize_output_0_clone_1 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00606991 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00863355 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0060661 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0060661 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.41/Concat_/model.39/Resize_output_0_clone_1 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00399682 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00579383 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00287058 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00287058 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.41/Concat_/model.39/Resize_output_0_clone_1 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00831289 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587648 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026615 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0026615 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) long-strided -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038074 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593554 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268292 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00268292 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) long-strided -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00550875 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603219 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00551138 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00550875 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) long-strided -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00382304 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586076 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00378839 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00378839 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) long-strided -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00558242 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585564 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248749 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248749 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) long-strided -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00446914 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621105 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00448414 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00446914 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) long-strided -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00341192 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589239 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00278506 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00278506 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00278286 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599981 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00277213 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00277213 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00379994 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583954 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267962 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00267962 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00558505 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595962 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00555886 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00555886 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00378394 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00580681 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00379741 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00378394 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00296965 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00580425 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270913 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00270913 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00567174 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00578213 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248599 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248599 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00445964 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618514 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004468 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00445964 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344414 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00579365 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0027826 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0027826 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00574574 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058101 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240594 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240594 [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.44/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038317 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590135 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267818 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00267818 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.44/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00541003 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599333 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00542391 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00541003 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.44/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00380848 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584101 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00380608 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00380608 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.44/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00540918 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00581559 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247653 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00247653 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.44/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00446514 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00625232 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00450171 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00446514 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.44/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344555 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585655 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00278488 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00278488 [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.44/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00380391 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587868 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269164 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00269164 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.44/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00540292 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598514 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00540106 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00540106 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.44/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0037991 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583973 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00380271 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0037991 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.44/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00540817 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584448 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248331 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248331 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.44/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00450357 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00628273 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00448071 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00448071 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.44/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034289 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582546 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00279235 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00279235 [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) long-strided -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) long-strided -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) long-strided -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) long-strided -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) long-strided -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) long-strided -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.45/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00285383 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608095 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00276528 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00276528 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.45/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00381089 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599733 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268419 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00268419 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.45/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0054786 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607962 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00548504 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0054786 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.45/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00380247 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059901 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00380102 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00380102 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.45/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00295258 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00728046 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268851 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00268851 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.45/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00549367 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599067 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249498 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249498 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.45/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00446986 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621352 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00446629 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00446629 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.45/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00343826 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596838 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00277925 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00277925 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.45/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00561284 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597676 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243479 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00243479 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.44/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00276176 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006164 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00277187 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00276176 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.44/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00381582 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006004 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269939 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00269939 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.44/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00537143 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604876 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00538751 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00537143 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.44/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0037979 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617467 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00379765 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00379765 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.44/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00294904 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596895 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269325 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00269325 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.44/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00543458 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597714 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249766 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249766 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.44/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00447943 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00620838 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00447257 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00447257 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.44/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034474 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600152 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0027862 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0027862 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.44/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00554356 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606267 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243495 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00243495 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) long-strided -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00995413 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598114 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00996754 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00598114 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) long-strided -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00794946 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603352 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00795022 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00603352 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) long-strided -> Float(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00541511 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00656145 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00540444 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00540444 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) long-strided -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00994926 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599943 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00996206 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00599943 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) long-strided -> Float(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00538125 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587685 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00540004 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00538125 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) long-strided -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0109202 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599048 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0109316 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00599048 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254573 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604514 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266303 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00254573 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00996236 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603733 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00994194 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00603733 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00796089 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597048 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00793854 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00597048 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(6400,1600:32,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00541816 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006576 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0053992 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0053992 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(6400,1600:32,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0120838 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060581 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00264453 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00264453 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(6400,1600:32,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00997425 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603352 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00996846 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00603352 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Half(6400,1600:32,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00538633 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584302 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00539564 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00538633 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Half(6400,1600:32,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0109528 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604629 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0109531 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00604629 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Half(6400,1600:32,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00575598 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607543 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236853 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236853 [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.48/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00294297 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0987429 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00294652 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00294297 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.48/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.004457 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607676 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00445354 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00445354 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.48/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00744434 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611924 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00745326 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00611924 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.48/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00547335 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594615 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00545964 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00545964 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.48/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00586789 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597067 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00589312 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00586789 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.48/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00924457 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596457 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00927229 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00596457 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.48/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0057366 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00900572 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00575159 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0057366 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.48/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00437236 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602095 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00435435 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00435435 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.48/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00562673 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593554 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00563253 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00562673 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.51/Concat_/model.49/Resize_output_0_clone_1 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326483 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00861392 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00323017 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00323017 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.51/Concat_/model.49/Resize_output_0_clone_1 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00752529 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626564 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0035936 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0035936 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.51/Concat_/model.49/Resize_output_0_clone_1 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0123695 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621238 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0123806 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00621238 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.51/Concat_/model.49/Resize_output_0_clone_1 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00895714 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0127928 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00892773 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00892773 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.51/Concat_/model.49/Resize_output_0_clone_1 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00512098 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601695 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00331543 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00331543 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.51/Concat_/model.49/Resize_output_0_clone_1 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0124099 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611733 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00293738 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00293738 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) long-strided -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00502416 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596095 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00285723 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00285723 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) long-strided -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00766893 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608743 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00768529 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00608743 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) long-strided -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00502495 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00636462 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00503267 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00502495 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) long-strided -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00752068 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610381 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252744 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252744 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) long-strided -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00618628 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00879435 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00623761 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00618628 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) long-strided -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00392859 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603067 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00292068 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00292068 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00294204 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00650286 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00295874 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00294204 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00499295 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599257 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283715 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00283715 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00765642 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604743 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00769131 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00604743 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00502479 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00634633 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0050363 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00502479 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00316641 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595391 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00323637 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00316641 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0075508 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601543 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252792 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252792 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0062235 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00878817 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00619581 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00619581 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00392562 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599657 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00292497 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00292497 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00808838 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603619 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248977 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248977 [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(51200,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.54/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00502384 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598705 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00282873 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00282873 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.54/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00769011 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613086 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00768433 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00613086 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(204800,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.54/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00503015 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00633659 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0050177 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0050177 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.54/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0075232 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597905 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255372 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00255372 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(204800,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.54/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00624338 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00887449 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00623086 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00623086 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(51200,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.54/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.003915 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598952 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00291026 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00291026 [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(51200,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.54/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.004995 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594889 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00282837 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00282837 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.54/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00768144 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610629 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00770093 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00610629 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(204800,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.54/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00502463 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629664 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00502715 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00502463 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.54/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00754238 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598381 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252969 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252969 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(204800,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.54/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00620724 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00888632 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0062141 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00620724 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(51200,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.54/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00392537 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602781 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00290322 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00290322 [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(51200,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(204800,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(204800,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(51200,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(51200,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(204800,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(204800,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(51200,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) long-strided -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) long-strided -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) long-strided -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) long-strided -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) long-strided -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) long-strided -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.55/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00295995 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00665018 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00295435 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00295435 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.55/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0050136 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059901 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00284531 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00284531 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.55/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00765594 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616724 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00768072 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00616724 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.55/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00503425 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631016 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00501155 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00501155 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.55/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00316114 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060101 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00322641 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00316114 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.55/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00754334 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605657 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252167 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252167 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.55/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00621009 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00871502 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00622768 [04/18/2023-13:39:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00621009 [04/18/2023-13:39:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:25] [V] [TRT] --------------- Timing Runner: /model.55/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00392216 [04/18/2023-13:39:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603105 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00289481 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00289481 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.55/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00808584 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603181 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248378 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248378 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.54/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00294922 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00689981 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00299648 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00294922 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.54/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00501817 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602133 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00282918 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00282918 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.54/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00766869 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609733 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00768866 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00609733 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.54/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00502006 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629824 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00504954 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00502006 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.54/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00316959 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599791 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00323169 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00316959 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.54/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00748571 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600838 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252712 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252712 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.54/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00619809 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00871449 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00621675 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00619809 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.54/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00394452 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603257 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00291191 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00291191 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.54/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0080767 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604076 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248804 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248804 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) long-strided -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) long-strided -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) long-strided -> Float(409600,1600,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) long-strided -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) long-strided -> Float(409600,1600,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) long-strided -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(6400,1600:32,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(6400,1600:32,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(6400,1600:32,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Half(6400,1600:32,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Half(6400,1600:32,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Half(6400,1600:32,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.60/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00369629 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.193975 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00369477 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00369477 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.60/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00664208 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598686 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00297143 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00297143 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.60/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0118759 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605924 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0118752 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00605924 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.60/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00851146 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00797384 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00853808 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00797384 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.60/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00904657 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612781 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00907429 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00612781 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.60/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0156727 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00759603 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0156613 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00759603 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.60/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00833143 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0129638 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00838172 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00833143 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.60/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00583735 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613409 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00583954 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00583735 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.60/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00825854 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609505 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00824 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00609505 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.61/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00369747 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.193975 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00369582 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00369582 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.61/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00664166 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060221 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00296648 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00296648 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.61/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0118906 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0061099 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.011866 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0061099 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.61/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0085276 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00641113 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00851012 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00641113 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.61/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00909743 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0061461 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00899829 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0061461 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.61/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0156942 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615524 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0156704 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00615524 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.61/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00834768 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0129899 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0083553 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00834768 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.61/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00582181 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609829 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00582748 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00582181 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: /model.61/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00822908 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610476 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00824737 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00610476 [04/18/2023-13:39:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) long-strided -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) long-strided -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) long-strided -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) long-strided -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) long-strided -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) long-strided -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-13:39:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0323977 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0250164 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.032651 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0250164 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0360229 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0242834 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0363051 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0242834 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0635368 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0240869 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0635368 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0240869 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Float(1:4,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.100279 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0707413 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.097984 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0707413 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0155218 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0175076 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0235252 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0155218 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0195251 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0220056 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0175106 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0175106 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0335003 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0172744 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0179697 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0172744 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0333559 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0170626 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0334409 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0170626 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0473234 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01696 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0470309 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.01696 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(1:8,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.136046 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0708511 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0512975 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0512975 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(1632000:32,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.04479 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.313637 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.04713 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.313637 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0325851 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0349595 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0325339 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0325339 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Float(409600,1:4,5120,64) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0238469 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0349915 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.024061 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0238469 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0854263 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0350171 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0853691 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0350171 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Float(1:4,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.177883 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0768 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.177591 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0768 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(1632000,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0305152 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0361033 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0304037 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0304037 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(819200,6400:2,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0315648 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0361006 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0315273 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0315273 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(204800,1:8,2560,32) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.020702 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0334967 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.020657 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.020657 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(102400,1:16,1280,16) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0209607 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.036784 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0209704 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0209607 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0665356 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0341979 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0661699 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0341979 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(1:8,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.205938 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0758491 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.206066 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0758491 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(1632000:32,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.0574 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.27765 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.05488 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.27765 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0332105 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0360594 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0330606 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0330606 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Float(1632000,1,20400,255) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0230576 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0346112 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0229505 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0229505 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0835291 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0351671 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0835291 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0351671 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Float(1:4,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.174519 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0766766 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.176274 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0766766 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(1632000,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0300178 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0360457 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0299008 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0299008 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(819200,6400:2,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0300471 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0341925 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0301641 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0300471 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(204800,1:8,2560,32) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0233855 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0345234 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0232784 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0232784 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(102400,1:16,1280,16) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0234057 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0340846 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0233855 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0233855 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0648046 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0361691 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0649021 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0361691 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(1:8,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.204361 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0754834 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.20597 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0754834 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(1632000:32,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.05644 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.277065 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.0543 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.277065 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0284526 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0346313 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0285272 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0284526 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0235422 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0361326 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0234475 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0234475 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0253379 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0352101 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.025136 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.025136 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Float(1:4,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.168667 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0769463 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.16779 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0769463 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0265577 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0344064 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0263139 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0263139 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0279802 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0332818 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0279383 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0279383 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0234194 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0352256 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0234893 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0234194 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0235102 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0331419 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0235063 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0235063 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0615954 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0337381 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0615863 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0337381 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(1:8,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.19973 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0758491 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.198802 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0758491 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(1632000:32,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.03192 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.276919 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.10036 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.276919 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0502248 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.66048 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0517775 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0502248 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0511467 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.663109 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0509928 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0509928 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0545295 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.659163 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.054272 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.054272 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0659749 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.662235 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0670415 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0659749 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0453154 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.339529 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0452023 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0452023 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.045568 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.314222 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.045312 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.045312 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0476404 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.311296 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0472091 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0472091 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0476891 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.311442 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.047616 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.047616 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0488594 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.311296 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0489189 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0488594 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(1:8,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.169106 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.339648 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.166473 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.166473 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(1632000:32,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.05532 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.294907 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.06869 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.294907 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0173328 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0327214 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.020898 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0173328 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0310546 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0345006 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0311077 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0310546 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.034933 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0359506 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.034603 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.034603 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0648533 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0339968 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0637836 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0339968 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Float(1:4,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0934034 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.314953 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0942789 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0934034 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0183909 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0347867 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0135501 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0135501 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0309285 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0347218 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0152585 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0152585 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0311296 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0347575 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0310976 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0310976 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0457509 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0338798 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0457554 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0338798 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Half(1:8,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.132535 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0687543 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0492038 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0492038 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Half(1632000:32,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.1921 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.211648 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.16665 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.211648 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0208823 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0313929 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0177488 [04/18/2023-13:39:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0177488 [04/18/2023-13:39:26] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-13:39:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0242773 [04/18/2023-13:39:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0336411 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0241371 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0241371 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0264777 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0332946 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0267398 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0264777 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0652861 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0354917 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0642118 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0354917 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Float(1:4,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.167058 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.318464 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.165271 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.165271 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0182857 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0422114 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.013361 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.013361 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.022946 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0354304 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0128686 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0128686 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.022946 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0322697 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0229074 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0229074 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0462629 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.034816 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0461531 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.034816 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Half(1:8,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.196315 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0856549 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.195145 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0856549 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Half(1632000:32,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.04084 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.226144 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.01978 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.226144 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0305929 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0345819 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0173953 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0173953 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Float(1632000,1,20400,255) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0213192 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0337691 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0213394 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0213192 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Float(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0248221 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0324169 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0248686 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0248221 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0816274 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0339675 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0816274 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0339675 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Float(1:4,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.168375 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.317147 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.166181 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.166181 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Half(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0232176 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0374857 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0111606 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0111606 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Half(819200,6400:2,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0240853 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0346917 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0100709 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0100709 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Half(102400,1:16,1280,16) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0218279 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.032768 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0220682 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0218279 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0623665 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0350208 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.062269 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0350208 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Half(1:8,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.197047 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0761166 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.196754 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0761166 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Half(1632000:32,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.04903 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.220306 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.02153 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.220306 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0305115 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0344951 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0308882 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0305115 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Float(1632000,1,20400,255) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0212937 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0370754 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0213205 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0212937 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Float(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0253242 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.03536 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0250377 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0250377 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0816274 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0334629 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0816526 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0334629 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Float(1:4,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.169106 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.317294 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.167205 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.167205 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Half(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0235056 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.044544 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0231184 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0231184 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Half(819200,6400:2,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.024381 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0345737 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0240678 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0240678 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Half(204800,1:8,2560,32) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0219631 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0347438 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0219011 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0219011 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0623299 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0347657 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0623482 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0347657 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Half(1:8,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.196727 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0759954 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.196754 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0759954 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Half(1632000:32,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.03996 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.220453 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.03309 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.220453 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0248861 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0351963 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0246956 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0246956 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0220474 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0344549 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0217613 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0217613 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0251939 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0358766 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0251154 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0251154 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0720457 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.033792 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0716069 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.033792 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Float(1:4,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.163255 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.31744 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.163712 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.163255 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0242796 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0379497 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0238278 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0238278 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0236565 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0339383 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0236774 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0236565 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0220447 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0329435 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0219638 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0219638 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0219442 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0333614 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0219847 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0219442 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Half(1:8,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.193682 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0767863 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.193829 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0767863 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Half(1632000:32,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.0366 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.222208 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.03177 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.222208 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0501623 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.221038 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0498347 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0498347 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0512091 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.226597 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0509562 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0509562 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0542141 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.226743 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0541303 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0541303 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0665112 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.226688 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0664853 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0664853 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Float(1:4,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.127634 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.368215 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.128096 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.127634 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0450629 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.04112 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0448366 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0448366 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0451063 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.00908 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0454217 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0451063 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0471406 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.03921 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.047616 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0471406 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0477836 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.02868 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0473131 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0473131 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0499688 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.02224 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0507124 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0499688 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Half(1632000:32,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.0635 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.299278 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.07447 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.299278 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0877897 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.224256 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0871131 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0871131 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.16501 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.2304 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.16501 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.16501 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.166766 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.229815 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.166213 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.166213 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0912091 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.229815 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0928183 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0912091 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Float(1:4,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.162523 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.377563 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.16501 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.162523 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0826514 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.04916 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0831634 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0826514 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0832366 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.02268 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0828709 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0828709 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.162377 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.04199 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.162962 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.162377 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.162117 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.06394 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.161792 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.161792 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0833097 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.06715 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0833097 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0833097 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Half(1:8,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.208165 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.121856 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.208457 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.121856 [04/18/2023-13:39:27] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0355154 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0355867 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0353783 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0353783 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Float(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(819200,6400:2,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0218136 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0345874 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0218142 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0218136 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(204800,1:8,2560,32) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(102400,1:16,1280,16) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Float(1632000,1,20400,255) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(819200,6400:2,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0247467 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0344009 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0248183 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0247467 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(204800,1:8,2560,32) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(102400,1:16,1280,16) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.02416 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0335287 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0241318 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0241318 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0475577 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.311296 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0475794 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0475577 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Half(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0315712 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0383291 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0312384 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0312384 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Half(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0232039 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0374891 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0231399 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0231399 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(409600,1:4,5120,64) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.030368 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0338432 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0301083 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0301083 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(409600,1:4,5120,64) -> Float(1632000,1,20400,255) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0206465 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0336229 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0207491 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0206465 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(409600,1:4,5120,64) -> Float(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0245059 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0337271 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.024461 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.024461 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(409600,1:4,5120,64) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0804571 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0389486 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0807429 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0389486 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(409600,1:4,5120,64) -> Half(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0230988 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0386103 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0231171 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0230988 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(409600,1:4,5120,64) -> Half(819200,6400:2,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0243352 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.036864 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0243878 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0243352 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(409600,1:4,5120,64) -> Half(204800,1:8,2560,32) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0219579 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0361714 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0219886 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0219579 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(409600,1:4,5120,64) -> Half(102400,1:16,1280,16) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.021854 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0349659 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0220114 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.021854 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(409600,1:4,5120,64) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0622217 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0369623 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0622446 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0369623 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Float(1632000,1,20400,255) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Float(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Half(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Half(819200,6400:2,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Half(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0220611 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0358034 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0220676 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0220611 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Half(102400,1:16,1280,16) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Float(1632000,1,20400,255) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Float(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Half(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Half(819200,6400:2,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Half(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.021841 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0339776 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0217966 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0217966 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Half(204800,1:8,2560,32) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Half(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0220069 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0329253 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0220689 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0220069 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Half(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0474069 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.00411 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0470309 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0470309 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Half(409600,1:4,5120,64) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.161353 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.01815 [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.161353 [04/18/2023-13:39:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.161353 [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:39:27] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0264846 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0348471 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0265082 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0264846 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.026941 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0346697 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0268427 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0268427 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.112567 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0359863 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.112619 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0359863 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0158801 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0332023 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0240884 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0158801 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0199629 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0336457 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0173161 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0173161 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0240472 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0357211 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0239909 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0239909 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0241615 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0349303 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0161351 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0161351 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0238682 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0198583 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0240587 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0198583 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.062973 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0190377 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0630004 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0190377 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0323584 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0258682 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0323291 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0258682 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0227618 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0236212 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0226952 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0226952 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.128146 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.026544 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.128311 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.026544 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0294327 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.020136 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0293129 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.020136 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0311589 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0210593 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0311031 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0210593 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0198623 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173069 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0198749 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0173069 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0198303 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0172978 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0199063 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0172978 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0199023 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173943 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.019936 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0173943 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0825051 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0177966 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.082576 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0177966 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0330487 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.025875 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0329061 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.025875 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0226795 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0235513 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0229512 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0226795 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.130361 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0256533 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.130414 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0256533 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0306057 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0189046 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0305152 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0189046 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0316489 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0206263 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.031627 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0206263 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0227775 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173633 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0228996 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0173633 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0228238 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0174298 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0228055 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0174298 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0228238 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0174867 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0228199 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0174867 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0833234 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.018072 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0837234 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.018072 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0300178 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0260632 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0301961 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0260632 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0231171 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0236565 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0233032 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0231171 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0241341 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0236408 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0240267 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0236408 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0275741 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0190091 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0275543 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0190091 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0276937 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0200229 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.027725 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0200229 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0233998 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.017379 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0233861 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.017379 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0234403 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173105 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0233946 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0173105 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0234266 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.017599 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0234083 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.017599 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0803109 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.017603 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0805303 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.017603 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.016928 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0182857 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.02077 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.016928 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0248335 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0184429 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0248564 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0184429 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0255779 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0191749 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0255223 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0191749 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.112713 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0207726 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.11293 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0207726 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.018256 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0133477 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0136652 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0133477 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0218031 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0374057 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0217992 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0217992 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0217339 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120114 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0110681 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0110681 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0217509 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119196 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.021792 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0119196 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0643581 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.013994 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.064416 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.013994 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0206681 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0198406 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0175335 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0175335 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0230296 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0187183 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0229544 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0187183 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0244709 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0186149 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0245326 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0186149 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.113006 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0208065 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.113152 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0208065 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0182491 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0414537 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0130593 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0130593 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0220604 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0160264 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0220428 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0160264 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0220362 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0159909 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0103556 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0103556 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0220232 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0160102 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0220441 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0160102 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0433737 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0157001 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0434103 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0157001 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.029813 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0197669 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0300178 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0197669 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0210769 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.018052 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0211461 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.018052 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0236225 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0180297 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0236428 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0180297 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.129609 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0203697 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.129755 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0203697 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0239017 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0370834 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0239421 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0239017 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0258613 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0194669 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0258918 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0194669 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0217757 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0149166 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0218122 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0149166 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0218155 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0151552 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0220056 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0151552 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0818469 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0150885 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0818469 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0150885 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0298907 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01942 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0166542 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0166542 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0212402 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0185886 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0212532 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0185886 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0239208 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0182149 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0236238 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0182149 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.129694 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0204395 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.12971 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0204395 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0238598 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0372011 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00847973 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00847973 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0257958 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0194709 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0083266 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0083266 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0218358 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0148919 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.021711 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0148919 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0217966 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0149947 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.021777 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0149947 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0812617 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.014885 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.081344 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.014885 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0299127 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0193097 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0297253 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0193097 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0210984 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0179629 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0210619 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0179629 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0236611 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0181029 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0236676 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0181029 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.129609 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0206426 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.129714 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0206426 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0238872 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0371909 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0238621 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0238621 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0258682 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0194749 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.025795 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0194749 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0217972 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0149979 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0217829 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0149979 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.021809 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0149166 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0218168 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0149166 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.081184 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0148795 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0811886 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0148795 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.024813 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0190206 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0247954 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0190206 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0211716 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0186337 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0211964 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0186337 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0236637 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01802 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0237257 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.01802 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.120759 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0211148 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.120905 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0211148 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0242126 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0373269 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0241166 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0241166 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0144425 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0191451 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0143945 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0143945 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0219833 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0151986 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0220408 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0151986 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0220108 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0181194 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.021999 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0181194 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0220682 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0151365 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0220212 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0151365 [04/18/2023-13:39:28] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0150587 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0178133 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.023888 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0150587 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0198246 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0208679 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0172927 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0172927 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0241211 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173968 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0162382 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0162382 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0328594 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0263581 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0327973 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0263581 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0298167 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.018964 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.029813 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.018964 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0316023 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.020689 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.031627 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.020689 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0203549 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0176041 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0207047 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0176041 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0339675 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.026429 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0339118 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.026429 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0312375 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01926 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0311323 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.01926 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0321207 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.021199 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0322112 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.021199 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0235873 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0175258 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0238255 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0175258 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.03072 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0266819 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0305737 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0266819 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.028029 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0193463 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.028035 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0193463 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.028144 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.020606 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0282187 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.020606 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0241615 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0174197 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0241615 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0174197 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0170672 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.018648 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0215562 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0170672 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0186829 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.013637 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0139965 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.013637 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0221721 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0122724 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0113688 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0113688 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0209646 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0202063 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0175197 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0175197 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0185383 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0420343 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0131981 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0131981 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0224777 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0163586 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0103615 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0103615 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0302043 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0195634 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0302811 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0195634 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0242636 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0374491 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0241128 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0241128 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.026099 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0197651 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0260373 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0197651 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0220415 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0151991 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0219657 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0151991 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0300763 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0194451 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0166197 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0166197 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.024141 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0375589 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00848995 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00848995 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0262171 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.019932 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00848054 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00848054 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0302811 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0196503 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0300763 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0196503 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0244328 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0377051 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.02448 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0244328 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0261851 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0199006 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0261859 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0199006 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0222981 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0152466 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0221864 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0152466 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0249905 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0193337 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0249836 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0193337 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0246491 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0378526 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0246979 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0246491 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0146661 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0195394 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0147557 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0146661 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0226743 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0153774 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0224065 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0153774 [04/18/2023-13:39:28] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) long-strided -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0259093 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0303205 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0259893 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0259093 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) long-strided -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0262034 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0301541 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0262827 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0262034 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) long-strided -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.109495 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0300983 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.10891 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0300983 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) long-strided -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0183783 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0208424 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0185154 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0183783 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) long-strided -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0196983 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0242834 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0199269 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0196983 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) long-strided -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0241105 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0178149 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0239726 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0178149 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) long-strided -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0238933 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.017892 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.023987 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.017892 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) long-strided -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0240724 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0178594 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0239025 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0178594 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) long-strided -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0630811 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0194897 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.063075 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0194897 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) long-strided -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0190217 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0209607 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0190377 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0190217 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) long-strided -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.024141 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0190749 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0242872 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0190749 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) long-strided -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.024928 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0187531 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0248823 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0187531 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) long-strided -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.109641 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0199886 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.109641 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0199886 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) long-strided -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0181663 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0171368 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0182709 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0171368 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) long-strided -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0207876 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0360137 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0207804 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0207804 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) long-strided -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0213368 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0152521 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0207967 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0152521 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) long-strided -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0207882 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0153166 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0207693 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0153166 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) long-strided -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0626179 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0180903 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.06272 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0180903 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) long-strided -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0202469 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0223465 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0202429 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0202429 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) long-strided -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.022592 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01912 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0225006 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.01912 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) long-strided -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.024192 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0192343 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0241653 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0192343 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) long-strided -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.109909 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0203703 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.109056 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0203703 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) long-strided -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0178823 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0513935 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0179383 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0178823 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) long-strided -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0215027 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0174735 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0214622 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0174735 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) long-strided -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.021423 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.017473 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0214002 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.017473 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) long-strided -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.021442 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0174583 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0214119 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0174583 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) long-strided -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0424594 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0172216 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0420731 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0172216 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) long-strided -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0299995 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0213016 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0299346 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0213016 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) long-strided -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0207615 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0171236 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0206681 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0171236 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) long-strided -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0232725 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.017058 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0233032 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.017058 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) long-strided -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.124782 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0196023 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.125001 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0196023 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) long-strided -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0238651 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0462994 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0238156 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0238156 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) long-strided -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0257524 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0228219 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0258278 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0228219 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) long-strided -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0211089 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0146016 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0212003 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0146016 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) long-strided -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0210854 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0145262 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0210978 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0145262 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) long-strided -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.078848 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0160752 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0787749 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0160752 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1555200,518400,6480,81,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0219814 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0244785 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0219918 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0219814 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1555200,518400,6480,81,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0250149 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.029963 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0251093 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0250149 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1555200,518400,6480,81,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0253714 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0299575 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0252922 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0252922 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1555200,518400,6480,81,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.10869 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0300453 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.108667 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0300453 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1555200,518400,6480,81,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0180977 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0206472 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.018036 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.018036 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1555200,518400,6480,81,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0194926 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0239383 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0195086 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0194926 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1555200,518400,6480,81,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0230909 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0177178 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0231184 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0177178 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1555200,518400,6480,81,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0231523 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0177097 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0230674 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0177097 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1555200,518400,6480,81,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0230713 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0177793 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0230263 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0177793 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Float(1555200,518400,6480,81,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.063261 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0192926 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0638293 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0192926 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1555200,518400,6480,81,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0190634 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0210488 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0189543 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0189543 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1555200,518400,6480,81,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0242103 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0185617 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0242057 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0185617 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1555200,518400,6480,81,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0247718 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0185709 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.024755 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0185709 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1555200,518400,6480,81,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.110078 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0205388 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.109641 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0205388 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1555200,518400,6480,81,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0157262 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0548556 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.015755 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0157262 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1555200,518400,6480,81,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0177331 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0169407 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0176462 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0169407 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1555200,518400,6480,81,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0202463 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0360229 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.020208 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.020208 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1555200,518400,6480,81,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0201509 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0148805 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0201806 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0148805 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1555200,518400,6480,81,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0200783 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0149362 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.020096 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0149362 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(1555200,518400,6480,81,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0624625 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0179686 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.062432 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0179686 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(777600,259200,6480:2,81,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0200223 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0221936 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0201874 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0200223 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(777600,259200,6480:2,81,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0221029 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0190354 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0220656 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0190354 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(777600,259200,6480:2,81,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0238659 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0190326 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0238392 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0190326 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(777600,259200,6480:2,81,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.11005 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0201143 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.109646 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0201143 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(777600,259200,6480:2,81,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0175263 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0514865 [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0174436 [04/18/2023-13:39:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0174436 [04/18/2023-13:39:28] [V] [TRT] *************** Autotuning Reformat: Half(777600,259200,6480:2,81,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00952114 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.023761 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00960152 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00952114 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(777600,259200,6480:2,81,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0210991 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173206 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0211285 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0173206 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(777600,259200,6480:2,81,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0211984 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0172841 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0210664 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0172841 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(777600,259200,6480:2,81,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0210527 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0172455 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0209019 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0172455 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(777600,259200,6480:2,81,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0414971 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0169514 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0415086 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0169514 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,1:8,810,10) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.029813 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0211069 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0297765 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0211069 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,1:8,810,10) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0203817 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0172455 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0203394 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0172455 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,1:8,810,10) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0228441 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0179069 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0229022 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0179069 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,1:8,810,10) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.123968 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.019636 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.123758 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.019636 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,1:8,810,10) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0233705 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0454583 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.023343 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.023343 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,1:8,810,10) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0253646 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0223118 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0252419 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0223118 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,1:8,810,10) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0205721 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0144315 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0205858 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0144315 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,1:8,810,10) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0205845 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0143264 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0206727 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0143264 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,1:8,810,10) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0206054 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0143625 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0206054 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0143625 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,1:8,810,10) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0781166 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0159233 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0781097 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0159233 [04/18/2023-13:39:29] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-13:39:29] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-13:39:29] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00291974 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062881 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00294988 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00291974 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00304194 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630678 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00302019 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00302019 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00500824 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062714 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00503929 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00500824 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00302428 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582949 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00303648 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00302428 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00208126 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00932086 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00264337 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00208126 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271319 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592421 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00227752 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00227752 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00293476 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059581 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251052 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251052 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00293915 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594066 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00294773 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00293915 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00376517 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596667 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00377107 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00376517 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00307385 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583845 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250246 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250246 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0230544 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599238 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0230713 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00599238 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00298952 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00628094 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00298324 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00298324 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0026891 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631433 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265702 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00265702 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00524833 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631612 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00524784 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00524784 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0039103 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00656478 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00395972 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0039103 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00300048 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594505 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00298762 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00298762 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00304078 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00577682 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.003028 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.003028 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271552 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591964 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00275622 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00271552 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266006 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596286 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265769 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00265769 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00409482 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588306 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004096 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00409482 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00455029 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00654483 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00454629 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00454629 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0233855 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00665309 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.023392 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00665309 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00301019 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00628154 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00301762 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00301019 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(38400,12800,1,160,80) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00265549 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631692 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267285 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00265549 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00531166 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00671023 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00532368 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00531166 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00391388 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00656727 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00391351 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00391351 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.003024 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588197 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00300505 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00300505 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00305828 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00577646 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00309534 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00305828 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266159 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590537 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269921 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266159 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269913 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590373 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272155 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00269913 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00418834 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582546 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00419696 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00418834 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00459457 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00652031 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00458871 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00458871 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0235879 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00718674 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0234351 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00718674 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00313053 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00635905 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.003026 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.003026 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266108 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00634017 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269818 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266108 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.002725 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630837 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0027156 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0027156 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00371411 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00654358 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00372243 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00371411 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00304126 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00581413 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00302 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00302 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00305751 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00573239 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00306966 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00305751 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270465 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00572983 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269645 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00269645 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271396 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00570936 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271396 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00271396 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00409848 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00575159 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00407505 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00407505 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00448971 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00648904 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00447214 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00447214 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0235866 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00715314 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0233371 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00715314 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00291173 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00992457 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00281994 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00281994 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00315836 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0123417 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00314445 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00314445 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00317613 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0122042 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00326203 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00317613 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00516441 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0122537 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00518367 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00516441 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00284101 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0057062 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00282703 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00282703 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00296331 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00647851 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00294876 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00294876 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00316204 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00648348 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00315319 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00315319 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00316303 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0065201 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00314723 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00314723 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00397943 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00655647 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00396145 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00396145 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00311732 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00575287 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00310648 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00310648 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0233326 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610019 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0231471 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00610019 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00212202 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00940343 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238141 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00212202 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0028875 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583132 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0029131 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0028875 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00297012 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058752 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00295529 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00295529 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00494944 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590318 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00492973 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00492973 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00298419 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00567068 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00293812 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00293812 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00261428 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593079 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00230211 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00230211 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00288064 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611067 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249647 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249647 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00289316 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588343 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00288887 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00288887 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00401968 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591324 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00403479 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00401968 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00303476 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586405 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249048 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249048 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0232131 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603581 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0232947 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00603581 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271862 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00570813 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00222875 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00222875 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00274087 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.005712 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00276035 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00274087 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00281591 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058432 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00280991 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00280991 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00500004 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583296 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00500635 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00500004 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00333597 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00649704 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00333246 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00333246 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00263913 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596419 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00221883 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00221883 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00272716 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590793 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023332 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0023332 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00274156 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059541 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00274036 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00274036 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00346601 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596057 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347494 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00346601 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00394242 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00665018 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039402 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0039402 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0232875 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00690286 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0233078 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00690286 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00321412 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589787 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00222678 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00222678 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(38400,12800,1,160,80) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266853 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611029 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267073 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266853 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270034 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608743 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272052 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00270034 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0053203 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058507 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00532351 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0053203 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00382075 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00655667 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00381245 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00381245 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00308902 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592494 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002238 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.002238 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00312437 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595333 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00220603 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00220603 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267082 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606286 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266557 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00266557 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00439785 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599295 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0043948 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0043948 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00439203 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00658597 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00438691 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00438691 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0235259 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00674161 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0235291 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00674161 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00318293 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585033 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00315637 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00315637 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(38400,12800,1,160,80) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268165 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597771 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268072 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00268072 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270655 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605981 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270379 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00270379 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.005344 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00982217 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00535534 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.005344 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00384337 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00648606 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00386311 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00384337 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0035744 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597352 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00309233 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00309233 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00311573 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587392 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00316939 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00311573 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268546 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604457 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267022 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00267022 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00441171 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589696 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00438012 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00438012 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00438982 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00654878 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00439051 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00438982 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0235102 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00661714 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0234684 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00661714 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.003008 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00580059 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0029959 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0029959 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266912 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586679 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266701 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00266701 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00308387 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592128 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269367 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00269367 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00507901 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609391 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00508201 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00507901 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344131 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00697948 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345742 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00344131 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00296882 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602229 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00295958 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00295958 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00273113 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585125 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00275569 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00273113 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271267 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596495 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265837 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00265837 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266396 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596895 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267716 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266396 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00403403 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006592 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0040386 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00403403 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0232549 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00667927 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0232862 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00667927 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00282918 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00566875 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00227258 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00227258 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0031682 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0064634 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00314713 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00314713 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00320884 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00652093 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00322712 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00320884 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00516408 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00651844 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00514351 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00514351 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00295379 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059339 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00295762 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00295379 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00278022 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112865 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00227367 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00227367 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00290898 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117419 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00290907 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00290898 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00312696 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117327 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0031516 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00312696 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0031356 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117218 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00312924 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00312924 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0040419 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0131595 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00404267 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0040419 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0230831 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583516 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0230511 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00583516 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00318903 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582382 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00314832 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00314832 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00335107 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00652925 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334395 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00334395 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00337265 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00664499 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00337786 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00337265 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00525584 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00654836 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00525208 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00525208 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00297759 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601848 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00300362 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00297759 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00308221 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112745 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00307988 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00307988 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00322682 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116775 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00324663 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00322682 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00328997 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117324 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00332083 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00328997 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0032933 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117331 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0032986 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0032933 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00406908 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0131183 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00407975 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00406908 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00313163 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00575982 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00311135 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00311135 [04/18/2023-13:39:29] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,160,2,1) -> Float(12800,12800,1,160,80) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00262824 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618838 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00262309 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00262309 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,160,2,1) -> Float(3200,3200,1:4,40,20) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00264779 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00620057 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026494 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00264779 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,160,2,1) -> Float(480,480,160:32,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00337967 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0061819 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00338785 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00337967 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00260438 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586112 [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00263988 [04/18/2023-13:39:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00260438 [04/18/2023-13:39:29] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,160,2,1) -> Half(12800,12800,160,2,1) *************** [04/18/2023-13:39:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00194928 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608267 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023917 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00194928 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,160,2,1) -> Half(6400,6400,160:2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024623 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585948 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00210319 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00210319 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,160,2,1) -> Half(1600,1600,1:8,20,10) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00265896 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604171 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251597 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251597 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,160,2,1) -> Half(800,800,1:16,10,5) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00265507 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058123 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265033 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00265033 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,160,2,1) -> Half(480,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00285248 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584229 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283966 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00283966 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0028411 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00581065 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249837 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249837 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0236415 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597752 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0236643 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00597752 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,1,160,80) -> Float(12800,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0026797 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00635667 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267547 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00267547 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,1,160,80) -> Float(3200,3200,1:4,40,20) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246307 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00637356 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246447 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00246307 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,1,160,80) -> Float(480,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342792 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00633302 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345883 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00342792 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,1,160,80) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00352792 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00664125 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00354743 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00352792 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,1,160,80) -> Half(12800,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0026676 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598686 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266362 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00266362 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,1,160,80) -> Half(6400,6400,160:2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0026941 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596229 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269792 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0026941 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,1,160,80) -> Half(1600,1600,1:8,20,10) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247551 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603124 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244641 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00244641 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,1,160,80) -> Half(800,800,1:16,10,5) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247133 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609829 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246834 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246834 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,1,160,80) -> Half(480,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00295202 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059328 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00296135 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00295202 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,1,160,80) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00391821 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00661486 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039313 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00391821 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,1,160,80) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.023853 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00697295 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0238385 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00697295 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1:4,40,20) -> Float(12800,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00272268 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0063513 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269999 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00269999 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1:4,40,20) -> Float(12800,12800,1,160,80) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00244796 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00635647 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247906 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00244796 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1:4,40,20) -> Float(480,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00343195 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00647533 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346819 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00343195 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1:4,40,20) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00351253 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00662088 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349737 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00349737 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1:4,40,20) -> Half(12800,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269965 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600572 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269046 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00269046 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1:4,40,20) -> Half(6400,6400,160:2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271448 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594304 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272423 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00271448 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1:4,40,20) -> Half(1600,1600,1:8,20,10) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252231 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603848 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024945 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0024945 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1:4,40,20) -> Half(800,800,1:16,10,5) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251918 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602076 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250207 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250207 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1:4,40,20) -> Half(480,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00296863 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591068 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00298048 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00296863 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1:4,40,20) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00394675 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00658597 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00395836 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00394675 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1:4,40,20) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0237956 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00678795 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0237832 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00678795 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(480,480,160:32,2,1) -> Float(12800,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268495 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631016 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026836 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0026836 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(480,480,160:32,2,1) -> Float(12800,12800,1,160,80) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246113 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0063195 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247094 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00246113 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(480,480,160:32,2,1) -> Float(3200,3200,1:4,40,20) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250341 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00634017 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249308 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249308 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(480,480,160:32,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0035025 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006576 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349993 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00349993 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(480,480,160:32,2,1) -> Half(12800,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268538 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602743 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270473 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00268538 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(480,480,160:32,2,1) -> Half(6400,6400,160:2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00272026 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587666 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271336 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00271336 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(480,480,160:32,2,1) -> Half(1600,1600,1:8,20,10) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252134 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588892 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250018 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250018 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(480,480,160:32,2,1) -> Half(800,800,1:16,10,5) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251108 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590208 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251028 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251028 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(480,480,160:32,2,1) -> Half(480,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00302048 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588599 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00301552 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00301552 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(480,480,160:32,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00392315 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00655875 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00390709 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00390709 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(480,480,160:32,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0236774 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00695488 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.023761 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00695488 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(12800,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251806 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00984046 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253891 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00251806 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(12800,12800,1,160,80) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00281869 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121707 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00275437 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00275437 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(3200,3200,1:4,40,20) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00282712 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121642 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283563 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00282712 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(480,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00357817 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012176 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00448657 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00357817 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(12800,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025126 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00712984 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251228 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251228 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(6400,6400,160:2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0026582 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00657475 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00264965 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00264965 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(1600,1600,1:8,20,10) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00281627 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00653901 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0028324 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00281627 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(800,800,1:16,10,5) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00280009 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00678566 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00281851 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00280009 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(480,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00298352 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00660945 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00297895 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00297895 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00285508 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00581029 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00286528 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00285508 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0235683 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597105 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0236278 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00597105 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800,160,2,1) -> Float(12800,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00192707 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611009 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00210763 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00192707 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800,160,2,1) -> Float(12800,12800,1,160,80) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00264345 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585253 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00264991 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00264345 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800,160,2,1) -> Float(3200,3200,1:4,40,20) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266472 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006032 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266861 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266472 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800,160,2,1) -> Float(480,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325652 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591506 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00327595 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00325652 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00262816 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583461 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265084 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00262816 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800,160,2,1) -> Half(6400,6400,160:2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239109 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605276 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0021122 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0021122 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800,160,2,1) -> Half(1600,1600,1:8,20,10) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00262068 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592987 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250373 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250373 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800,160,2,1) -> Half(800,800,1:16,10,5) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00260555 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595867 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00263156 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00260555 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800,160,2,1) -> Half(480,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0027796 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607657 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00278708 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0027796 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00289737 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602286 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248828 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248828 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0238354 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062881 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0237753 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0062881 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(6400,6400,160:2,2,1) -> Float(12800,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253265 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586185 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00206537 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00206537 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(6400,6400,160:2,2,1) -> Float(12800,12800,1,160,80) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00255861 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588965 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255951 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00255861 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(6400,6400,160:2,2,1) -> Float(3200,3200,1:4,40,20) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.002596 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593902 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00257649 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00257649 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(6400,6400,160:2,2,1) -> Float(480,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00327595 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587045 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00328332 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00327595 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(6400,6400,160:2,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00336595 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00657122 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00335075 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00335075 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(6400,6400,160:2,2,1) -> Half(12800,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242495 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060221 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00205845 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00205845 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(6400,6400,160:2,2,1) -> Half(1600,1600,1:8,20,10) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254172 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602057 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234859 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234859 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(6400,6400,160:2,2,1) -> Half(800,800,1:16,10,5) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025361 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599562 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254508 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0025361 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(6400,6400,160:2,2,1) -> Half(480,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266193 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600857 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002656 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.002656 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(6400,6400,160:2,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00375361 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00672478 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00375936 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00375361 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(6400,6400,160:2,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0238202 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00704958 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.023869 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00704958 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,1:8,20,10) -> Float(12800,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00274919 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582583 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0022227 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0022227 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,1:8,20,10) -> Float(12800,12800,1,160,80) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246684 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588654 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246305 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246305 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,1:8,20,10) -> Float(3200,3200,1:4,40,20) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252207 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596038 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250675 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250675 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,1:8,20,10) -> Float(480,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00335787 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583808 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00336096 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00335787 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,1:8,20,10) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00354899 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0065627 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00353762 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00353762 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,1:8,20,10) -> Half(12800,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268656 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590025 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00221426 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00221426 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,1:8,20,10) -> Half(6400,6400,160:2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267479 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584503 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00219844 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00219844 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,1:8,20,10) -> Half(800,800,1:16,10,5) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024585 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599886 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244936 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00244936 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,1:8,20,10) -> Half(480,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00291529 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598191 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00290158 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00290158 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,1:8,20,10) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00396442 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00665828 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00396503 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00396442 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,1:8,20,10) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.023968 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00709311 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0239177 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00709311 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(800,800,1:16,10,5) -> Float(12800,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269602 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585417 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271759 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00269602 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(800,800,1:16,10,5) -> Float(12800,12800,1,160,80) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247921 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594633 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247023 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00247023 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(800,800,1:16,10,5) -> Float(3200,3200,1:4,40,20) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251798 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594761 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249829 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249829 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(800,800,1:16,10,5) -> Float(480,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00334735 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591836 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334512 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00334512 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(800,800,1:16,10,5) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00356817 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00664706 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00356527 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00356527 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(800,800,1:16,10,5) -> Half(12800,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0026891 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594304 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267268 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00267268 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(800,800,1:16,10,5) -> Half(6400,6400,160:2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268538 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594542 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267615 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00267615 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(800,800,1:16,10,5) -> Half(1600,1600,1:8,20,10) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246313 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605219 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246361 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00246313 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(800,800,1:16,10,5) -> Half(480,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00291909 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597048 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0029099 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0029099 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(800,800,1:16,10,5) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00396454 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00671958 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00395008 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00395008 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(800,800,1:16,10,5) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0238926 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00754286 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0239215 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00754286 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(480,480,160:32,2,1) -> Float(12800,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0027175 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584997 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002688 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.002688 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(480,480,160:32,2,1) -> Float(12800,12800,1,160,80) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246384 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584777 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248079 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00246384 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(480,480,160:32,2,1) -> Float(3200,3200,1:4,40,20) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250731 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058838 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250795 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00250731 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(480,480,160:32,2,1) -> Float(480,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0032961 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588672 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00329371 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00329371 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(480,480,160:32,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00347287 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00661091 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345132 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00345132 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(480,480,160:32,2,1) -> Half(12800,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266252 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060741 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265609 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00265609 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(480,480,160:32,2,1) -> Half(6400,6400,160:2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00245067 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595529 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246408 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00245067 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(480,480,160:32,2,1) -> Half(1600,1600,1:8,20,10) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246692 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059621 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247519 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00246692 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(480,480,160:32,2,1) -> Half(800,800,1:16,10,5) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247779 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00821206 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249285 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00247779 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(480,480,160:32,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00377263 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00663231 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00378514 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00377263 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(480,480,160:32,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0236637 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0072528 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0236591 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0072528 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(12800,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025729 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00577792 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00227439 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00227439 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(12800,12800,1,160,80) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00276835 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006592 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00277899 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00276835 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(3200,3200,1:4,40,20) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00284576 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00659158 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00282012 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00282012 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(480,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00356772 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00659595 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00356828 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00356772 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269887 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594469 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268394 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00268394 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(12800,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00298457 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112707 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00225329 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00225329 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(6400,6400,160:2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.002584 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116417 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00262334 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.002584 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(1600,1600,1:8,20,10) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00275473 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116807 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00276229 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00275473 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(800,800,1:16,10,5) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00274971 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117433 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0027658 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00274971 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(480,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00292767 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130032 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00295342 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00292767 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0235931 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592366 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0235886 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00592366 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(12800,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267657 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587319 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268436 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00267657 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(12800,12800,1,160,80) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0028333 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00657288 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0028272 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0028272 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(3200,3200,1:4,40,20) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00284737 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00660945 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00284827 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00284737 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(480,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00328042 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00655584 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00329475 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00328042 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00281358 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597429 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00281376 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00281358 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(12800,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00264062 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112731 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00264146 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00264062 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(6400,6400,160:2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271181 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011622 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270586 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00270586 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(1600,1600,1:8,20,10) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00283222 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116863 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00280354 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00280354 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(800,800,1:16,10,5) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00281636 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116536 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00281824 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00281636 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(480,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00298905 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130273 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00297886 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00297886 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00291118 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596952 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00291806 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00291118 [04/18/2023-13:39:30] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(38400,12800,1,160,80) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(38400,12800,1,160,80) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(38400,12800,1,160,80) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00222945 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607962 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0022515 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00222945 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240747 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582345 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024189 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00240747 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242906 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00953197 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241821 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00241821 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238804 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00741166 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241143 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238804 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00188668 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595372 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00210185 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00188668 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238766 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597105 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00195901 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00195901 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240046 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590665 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00216997 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00216997 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239733 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585911 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239566 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239566 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242019 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599848 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024282 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00242019 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238453 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586569 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00210127 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00210127 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238728 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589111 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239124 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238728 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00197711 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599981 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00198256 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00197711 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024048 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598514 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024032 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0024032 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240739 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601695 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242681 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00240739 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249923 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00660675 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250585 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00249923 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00200832 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585582 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00206237 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00200832 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239474 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584905 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250246 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239474 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238606 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589879 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238141 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238141 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239665 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590043 [04/18/2023-13:39:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239192 [04/18/2023-13:39:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239192 [04/18/2023-13:39:30] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00244479 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058955 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238987 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238987 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249261 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00664603 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249253 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249253 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024934 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00666276 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255698 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0024934 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00225693 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585362 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00226029 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00225693 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00225586 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588562 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00226764 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00225586 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00244765 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599943 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024602 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00244765 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250843 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00659844 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251621 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00250843 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00225907 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594633 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00227302 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00225907 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239764 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582491 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240114 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239764 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239078 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589166 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239497 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239078 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241867 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589568 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023952 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0023952 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00244068 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596953 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244207 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00244068 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025215 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00658805 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00262741 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0025215 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250675 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00667159 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251132 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00250675 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00229805 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597448 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00229072 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00229072 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00229457 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00623046 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00228426 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00228426 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243781 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603981 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244339 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00243781 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252576 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00648785 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252295 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252295 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00229058 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597619 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00230175 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00229058 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240495 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586715 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243099 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00240495 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241379 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587922 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241707 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00241379 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242162 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587228 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243626 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00242162 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246051 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590427 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024547 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0024547 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252864 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00648407 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252832 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252832 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254524 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00654629 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251076 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251076 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00226129 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588343 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00224957 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00224957 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239048 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00643816 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239794 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239048 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252704 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006431 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253947 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00252704 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00256947 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0064477 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00262733 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00256947 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233674 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583717 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00226471 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00226471 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251437 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0064314 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251405 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251405 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00257241 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00693747 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251413 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251413 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251589 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00642146 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025195 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00251589 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251292 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00645645 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025203 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00251292 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241364 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596038 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243022 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00241364 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239474 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590994 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239413 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239413 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00189173 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006084 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00205597 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00189173 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00224814 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584357 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0022545 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00224814 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240114 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593554 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239985 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239985 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00245432 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605924 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246912 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00245432 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239177 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596381 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240145 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239177 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237902 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006128 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00193458 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00193458 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023641 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059781 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00216713 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00216713 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237272 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597714 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235519 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235519 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238949 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614476 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240175 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238949 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236096 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605829 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00209106 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00209106 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239139 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598076 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239307 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239139 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00229834 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006276 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00190994 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00190994 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00226771 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.005856 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00226953 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00226771 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241143 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585838 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242991 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00241143 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024722 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593609 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247385 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0024722 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252928 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00652945 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254228 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00252928 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00223886 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612019 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00190274 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00190274 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237107 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585509 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00205675 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00205675 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238705 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596648 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237542 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237542 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238469 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609257 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238773 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238469 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249837 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00651055 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249868 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00249837 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247393 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00658743 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247905 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00247393 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00227345 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00580005 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00203371 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00203371 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00225529 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00581083 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00228978 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00225529 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240442 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610057 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243859 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00240442 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248008 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00567736 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252977 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00248008 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00261162 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629406 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00258735 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00258735 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235833 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00656312 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00202733 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00202733 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238133 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591232 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00202772 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00202772 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237415 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594194 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238804 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237415 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023968 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596571 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239017 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239017 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249829 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00651325 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248694 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248694 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246747 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00641252 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248386 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00246747 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00227077 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582162 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00229087 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00227077 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0022685 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00577664 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00226771 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00226771 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239924 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599905 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024571 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239924 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247772 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00581266 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246313 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246313 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252519 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00641471 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252351 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252351 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00224429 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589495 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00224764 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00224429 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238431 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588087 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239231 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238431 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237242 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582711 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238118 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237242 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238819 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592549 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239124 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238819 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024949 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00648288 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247504 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00247504 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248237 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00652405 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249403 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00248237 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00298114 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593609 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00230481 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00230481 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00229399 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058229 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243355 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00229399 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243936 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597143 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245517 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00243936 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250018 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601181 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248709 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248709 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253442 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00647771 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254115 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00253442 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00224779 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631811 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00225279 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00224779 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239619 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607543 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240709 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239619 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237879 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584869 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239215 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237879 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238248 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595867 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238956 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238248 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249506 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00651449 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249876 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00249506 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249245 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00657974 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249001 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249001 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00227345 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00576549 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00196052 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00196052 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235908 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0066828 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236403 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235908 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252616 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00669132 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253578 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00252616 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00261469 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00640258 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00262816 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00261469 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251332 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615714 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241143 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00241143 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0022525 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601752 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00195663 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00195663 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246463 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00651117 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247307 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00246463 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250175 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00658951 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248623 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248623 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248434 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00646837 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248016 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248016 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250988 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00644929 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248583 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248583 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237834 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592677 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237175 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237175 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00227635 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583644 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00228593 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00227635 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235556 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00648089 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235189 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235189 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253562 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006464 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252118 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252118 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254982 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00658909 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025591 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00254982 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243045 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.005992 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240526 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240526 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00225307 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595829 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00224893 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00224893 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248032 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00661465 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024616 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0024616 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024852 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00664499 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248087 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248087 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249521 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00664457 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249758 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00249521 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249915 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00663273 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250491 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00249915 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00277511 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00634952 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240419 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240419 [04/18/2023-13:39:31] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00315806 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106684 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00314017 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00314017 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00288466 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0165572 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00289463 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00288466 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00296499 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0167238 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00304943 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00296499 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00497198 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0165415 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00495669 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00495669 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00312894 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604133 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0031526 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00312894 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00324945 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00713382 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00323393 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00323393 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00294157 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00719634 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0029454 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00294157 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326088 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00719543 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002994 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.002994 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00293075 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00718377 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00292721 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00292721 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00403289 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00829054 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00403441 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00403289 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034277 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598648 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00344022 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0034277 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268436 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00628532 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00289618 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00268436 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270646 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0158016 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267251 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00267251 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00533333 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0169194 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00538751 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00533333 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00345785 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584704 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00341986 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00341986 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00350829 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00740891 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00348343 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00348343 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268208 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00679023 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268318 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00268208 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267048 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00679127 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267886 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00267048 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0026869 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00678462 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269283 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0026869 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00430373 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00744 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0042997 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0042997 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00348136 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00579474 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347842 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00347842 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267623 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0157696 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266912 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00266912 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269723 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0158153 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270034 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00269723 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00538531 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0165135 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00545541 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00538531 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00346329 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0099581 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347646 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00346329 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00356371 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00787729 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00357383 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00356371 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00284361 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00680795 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271888 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00271888 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0026952 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676738 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270258 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0026952 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270223 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00681339 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270749 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00270223 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00445119 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00743886 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00446571 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00445119 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00336244 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589129 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00335394 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00335394 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269393 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0165465 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00279244 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00269393 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270146 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0165384 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0027288 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00270146 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0053589 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0165836 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00542798 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0053589 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00335543 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590391 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334841 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00334841 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033735 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00742354 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00339115 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0033735 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271431 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00744663 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00273837 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00271431 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271664 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00743703 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00273406 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00271664 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270292 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00743017 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272544 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00270292 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00436696 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00744434 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00434535 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00434535 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325849 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0205688 [04/18/2023-13:39:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345643 [04/18/2023-13:39:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00325849 [04/18/2023-13:39:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:31] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0031519 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012333 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00315419 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0031519 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00319116 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012323 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00318974 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00318974 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00514531 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0122091 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00518171 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00514531 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00338541 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0395451 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346993 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00338541 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00347244 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114514 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00351922 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00347244 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0036032 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118822 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00373568 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0036032 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00338147 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112869 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346079 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00338147 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033819 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117085 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00351543 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0033819 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00420232 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114571 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00421566 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00420232 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00341279 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107827 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00350038 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00341279 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00339126 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102906 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00351755 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00339126 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00343227 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010449 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00353494 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00343227 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00507192 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103412 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00509005 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00507192 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00347298 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110031 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0036184 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00347298 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00341649 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0147081 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00356694 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00341649 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00362949 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0147291 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00379501 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00362949 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00335309 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0147456 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00343401 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00335309 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00338839 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0147141 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00476998 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00338839 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00398146 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0171977 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039859 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00398146 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00321544 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00712686 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00319441 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00319441 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00275086 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00918057 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00341105 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00275086 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00337446 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102704 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00344174 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00337446 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00509651 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101254 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00509226 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00509226 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00329392 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100785 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334597 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00329392 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00311503 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100608 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00338318 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00311503 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00346939 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102847 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00356014 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00346939 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00317928 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100955 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00341747 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00317928 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00319969 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104921 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334958 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00319969 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00338031 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010222 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347995 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00338031 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00347048 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101516 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347886 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00347048 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0032694 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101702 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00335979 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0032694 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0032828 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102998 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0035345 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0032828 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00531539 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100053 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00531962 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00531539 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00341649 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103246 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345273 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00341649 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00367109 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100882 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00353048 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00353048 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00343826 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105048 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00351822 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00343826 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00319553 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101001 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334862 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00319553 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00324581 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010305 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00341116 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00324581 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00428612 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102557 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00430992 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00428612 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00348136 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100172 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00348733 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00348136 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00329745 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100459 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0033886 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00329745 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033297 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102364 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0034412 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0033297 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00531996 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100328 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00532521 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00531996 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00340408 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100657 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00348256 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00340408 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00350049 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00991817 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00351387 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00350049 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00349324 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104931 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00369102 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00349324 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00322499 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103318 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00335607 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00322499 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00328883 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106077 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00348923 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00328883 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00430602 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103037 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00429459 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00429459 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00332439 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100273 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334203 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00332439 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00334501 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010465 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0034861 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00334501 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00350539 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101257 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349424 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00349424 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00513339 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100465 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.005136 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00513339 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00334214 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100681 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0033701 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00334214 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00319939 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100605 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00332375 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00319939 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00349815 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102426 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00361497 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00349815 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00327086 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100763 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346765 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00327086 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326171 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101483 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00335936 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00326171 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00340898 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101138 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349525 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00340898 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00329496 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0291941 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346155 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00329496 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00331564 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112928 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00338668 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00331564 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00333502 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011398 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00341965 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00333502 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00514743 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011309 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0051373 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0051373 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00327958 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0615863 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00362263 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00327958 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00340169 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117254 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349547 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00340169 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00338647 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118326 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00358926 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00338647 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00316343 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117373 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334799 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00316343 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00328125 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117792 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00333874 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00328125 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00425492 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0132405 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00437029 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00425492 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033701 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0292315 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00350015 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0033701 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00339934 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113783 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00350171 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00339934 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00343728 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114177 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.003472 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00343728 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00559314 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107399 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00558664 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00558664 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00337084 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0616838 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00348466 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00337084 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00346961 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118115 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00350339 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00346961 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00345992 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117598 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00358686 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00345992 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00334607 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118024 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00341921 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00334607 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00337361 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117345 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00342824 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00337361 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00434895 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130876 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0043466 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0043466 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00329039 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01067 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0034277 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00329039 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325517 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0165242 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334416 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00325517 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326909 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.016834 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349502 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00326909 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00512571 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0165303 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00507413 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00507413 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033013 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106864 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00337722 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0033013 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00329558 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100053 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0033734 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00329558 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00338754 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101699 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00357177 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00338754 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00327429 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100962 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00332843 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00327429 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00322062 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100254 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00333225 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00322062 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00398628 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010465 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00397828 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00397828 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344229 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101833 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0034851 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00344229 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0032559 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104408 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00341529 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0032559 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00331262 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0158117 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00343173 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00331262 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00531555 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0165191 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00534637 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00531555 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00343521 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.009544 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346971 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00343521 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00351654 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100194 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00352112 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00351654 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00348016 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102087 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00358777 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00348016 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033381 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101547 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00333831 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0033381 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325808 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102909 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00339413 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00325808 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00433081 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100501 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0043991 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00433081 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00348945 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00997181 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00352524 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00348945 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00327366 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0158075 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00340996 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00327366 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00334586 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0157664 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00367051 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00334586 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0054185 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0167731 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00549714 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0054185 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00348386 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00774472 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347418 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00347418 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00357509 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00743337 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00359669 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00357509 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271534 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00678816 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271776 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00271534 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270439 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00681774 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271569 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00270439 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269956 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00678608 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00269956 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00443318 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00745966 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00444094 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00443318 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00337074 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00573733 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334894 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00334894 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0026637 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0166131 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00275024 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0026637 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271422 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0165496 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272889 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00271422 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0052382 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.016514 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00522955 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00522955 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00333969 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00579584 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00335479 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00333969 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033718 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00743428 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00339072 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0033718 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00272716 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00797786 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0037606 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00272716 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00341867 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102776 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349257 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00341867 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00337138 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102909 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00352669 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00337138 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00439203 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108653 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00436945 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00436945 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00531217 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0206818 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.003272 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.003272 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00335245 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0122518 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00321605 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00321605 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00319157 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0122152 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00322428 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00319157 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00538345 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0122221 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0054102 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00538345 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.003272 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0396069 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00326151 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00326151 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342019 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00667491 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00343151 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00342019 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00316204 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673725 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00316899 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00316204 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00317613 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00667907 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00316353 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00316353 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00316879 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00663668 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00318537 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00316879 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00446543 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00664208 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00422992 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00422992 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00313769 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00623105 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00314812 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00313769 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0028939 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059619 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00289508 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0028939 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00296919 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606153 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00296844 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00296844 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00496252 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586496 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00495307 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00495307 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00313679 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630221 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00311205 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00311205 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00315389 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0147168 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00314633 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00314633 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00293551 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0146697 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00289335 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00289335 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00289289 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0147031 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00289289 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00289289 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00290276 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0147104 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00290084 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00290084 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00398552 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0171703 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00397994 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00397994 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00319258 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0071212 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00318984 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00318984 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00275411 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00741188 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00275613 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00275411 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0028238 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00741166 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002816 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.002816 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00499452 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0074432 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00499704 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00499452 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00314355 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00648209 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00341584 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00314355 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00324053 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010385 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00348212 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00324053 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00355546 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104575 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00367508 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00355546 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00330961 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102851 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00343967 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00330961 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033499 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101449 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349123 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0033499 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034178 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103416 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0032668 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0032668 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00347788 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00717806 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347625 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00347625 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266396 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675927 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268064 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266396 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270922 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675886 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272725 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00270922 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00527167 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00742766 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00527151 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00527151 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00339636 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603943 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00341225 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00339636 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00352881 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00748114 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00351866 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00351866 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268665 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00682863 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268081 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00268081 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266692 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00683102 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267827 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266692 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269105 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0067946 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267869 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00267869 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00425102 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00751223 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00425022 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00425022 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00347744 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00716503 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346754 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00346754 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266963 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00674764 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267776 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266963 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00273777 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675138 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271327 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00271327 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00529061 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00741394 [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00535958 [04/18/2023-13:39:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00529061 [04/18/2023-13:39:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:32] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:32] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00339795 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606933 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00339732 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00339732 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00350539 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00749486 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00353115 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00350539 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267818 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00681404 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00351822 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00267818 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00297189 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101815 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00311861 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00297189 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00296005 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102096 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00308474 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00296005 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00426985 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100047 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00433842 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00426985 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00332258 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00981577 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00332226 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00332226 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00299762 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.009236 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270758 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00270758 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00274113 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00745417 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00274752 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00274113 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00509903 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00841654 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00510628 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00509903 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00321046 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606476 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0033819 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00321046 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00333002 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103308 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0034363 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00333002 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00349213 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105401 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00362011 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00349213 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00330691 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105907 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00337488 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00330691 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00328717 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101138 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345502 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00328717 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00338679 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102198 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00355824 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00338679 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00333172 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0291291 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00329049 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00329049 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00314306 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00647612 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00316959 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00314306 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00320244 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00647732 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00321097 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00320244 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0054251 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00649183 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00540224 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00540224 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00317928 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0616351 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00319126 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00317928 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00332449 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116944 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00335617 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00332449 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00315886 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117211 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00316651 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00315886 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00316005 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117299 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00314723 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00314723 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.003152 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117647 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00315667 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.003152 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00426124 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0131337 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00426581 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00426124 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00337722 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0291173 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00341192 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00337722 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00336542 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00658057 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00335362 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00335362 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00336595 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00668031 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0033482 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0033482 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00542256 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00652862 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00541884 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00541884 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00331283 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0616762 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00335234 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00331283 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00348577 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117331 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346841 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00346841 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00332322 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117359 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334182 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00332322 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00329974 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117004 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0033201 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00329974 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00335033 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011751 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00333629 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00333629 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00435629 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130909 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00435435 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00435435 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.026192 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0247337 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0262446 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0247337 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0265265 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0252046 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0269143 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0252046 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.111031 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0261608 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.110738 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0261608 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0240747 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173283 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0242834 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0173283 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0241105 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173608 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0240808 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0173608 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0639269 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0186474 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0640731 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0186474 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0227807 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0237231 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0227585 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0227585 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.130267 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0258225 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.132375 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0258225 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0206387 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0174029 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0203297 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0174029 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0205897 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.017502 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.020416 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.017502 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0845531 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01822 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0846103 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.01822 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0230302 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.023759 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0228637 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0228637 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.132462 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0260785 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.13539 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0260785 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0236343 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0177625 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0236598 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0177625 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0233913 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0174161 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0238446 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0174161 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0846789 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0184743 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0846263 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0184743 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0236147 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0237917 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0232424 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0232424 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0241859 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0236016 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0241425 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0236016 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0235115 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.017569 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0235102 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.017569 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0236349 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0175543 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0235461 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0175543 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0809029 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0175848 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0809623 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0175848 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0247322 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0184474 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0248838 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0184474 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0255764 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0190017 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0254552 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0190017 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.112818 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0209946 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.112933 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0209946 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.021711 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0375737 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0217339 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.021711 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0217489 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119589 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0217933 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0119589 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0644145 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0141041 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0649509 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0141041 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0232307 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0186463 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0231471 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0186463 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0246271 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0187126 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0247634 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0187126 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.11403 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0209456 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.11403 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0209456 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0220754 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0159863 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0220552 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0159863 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0221035 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0159949 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0220428 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0159949 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0433394 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0157664 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0432937 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0157664 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0211135 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0181029 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0211278 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0181029 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0236297 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0180463 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0236473 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0180463 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.129536 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0204356 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.129552 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0204356 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0217966 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0149445 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0217724 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0149445 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0815543 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0148178 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0806331 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0148178 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0209874 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0179394 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0208771 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0179394 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0236389 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.018096 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0235167 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.018096 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.128674 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0205009 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.128505 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0205009 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0216712 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0148187 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0216947 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0148187 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0216758 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0148023 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.021666 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0148023 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0806034 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0147438 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0806034 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0147438 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0208673 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0186629 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0209025 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0186629 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0235233 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0181869 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0235265 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0181869 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.128613 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0205714 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.128816 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0205714 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0217319 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0147986 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0216033 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0147986 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.080384 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0148695 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0805303 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0148695 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0210024 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0184149 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0210821 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0184149 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0235318 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0179749 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0235102 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0179749 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.120101 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0210684 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.120101 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0210684 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0218808 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0150533 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0218351 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0150533 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0218384 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0150313 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0219494 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0150313 [04/18/2023-13:39:33] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(1632000,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1_copy_output (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0216869 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0230113 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0220571 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0216869 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(1,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1_copy_output (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0219233 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.022526 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.021713 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.021713 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(1:4,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1_copy_output (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.049696 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.658432 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0499322 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.049696 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(1632000:32,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1_copy_output (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0892343 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.662089 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0871863 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0871863 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(1632000,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1_copy_output (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0171571 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0183771 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.017087 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.017087 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(1632000:2,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1_copy_output (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0231314 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.222208 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0229466 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0229466 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(1:4,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1_copy_output (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.033344 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.222208 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0333824 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.033344 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(1:8,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1_copy_output (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0522728 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.222208 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0511025 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0511025 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(1:16,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1_copy_output (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0877714 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.223086 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0871017 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0871017 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1_copy_output (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0871863 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.22464 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0891611 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0871863 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) long-strided -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) long-strided -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) long-strided -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) long-strided -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) long-strided -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) long-strided -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.63/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00379753 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108287 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00412682 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00379753 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.63/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00450643 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0122057 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00386916 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00386916 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.63/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00566259 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00753949 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00570075 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00566259 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.63/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00392649 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00747451 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00391969 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00391969 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.63/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00307764 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0131117 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00423247 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00307764 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.63/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00562831 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0132979 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00437056 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00437056 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.63/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00459471 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0124587 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00469825 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00459471 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.63/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00468026 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117176 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00404863 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00404863 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.63/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00562145 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0131657 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00440132 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00440132 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.62/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00440797 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012085 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00422857 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00422857 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.62/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00406159 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116062 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00333852 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00333852 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.62/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00542645 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010896 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0054163 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0054163 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.62/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038145 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00959756 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00382689 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0038145 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.62/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00353427 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100081 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00285069 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00285069 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.62/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00551156 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0075212 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250939 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250939 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.62/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00451943 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00625192 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00452314 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00451943 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.62/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00346765 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600686 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283025 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00283025 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.62/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00559807 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595886 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024334 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0024334 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) long-strided -> Float(6400,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) long-strided -> Half(6400,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) long-strided -> Float(204800,400,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) long-strided -> Half(6400,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) long-strided -> Float(204800,400,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) long-strided -> Float(6400,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Float(204800,400,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Float(6400,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Half(6400,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Float(204800,400,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Float(6400,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(6400,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(204800,400,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(6400,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(6400,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.68/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00297357 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.103351 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0029551 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0029551 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.68/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00450414 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599295 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267132 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00267132 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.68/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0075265 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100846 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00755392 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0075265 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.68/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00544186 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598107 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00548605 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00544186 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.68/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00592658 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059403 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00593993 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00592658 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.68/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.009178 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601524 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00916686 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00601524 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.68/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00586478 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.008998 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00588105 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00586478 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.68/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00452971 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600876 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00453914 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00452971 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.68/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00572891 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596667 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00571798 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00571798 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.69/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00296266 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.103351 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00296676 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00296266 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.69/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00450143 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596552 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00280919 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00280919 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.69/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00751291 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606591 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00752553 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00606591 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.69/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0054632 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590299 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00547742 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0054632 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.69/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0059189 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601695 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00591104 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00591104 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.69/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00921543 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602114 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00919286 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00602114 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.69/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00587666 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00900114 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00587593 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00587593 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.69/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00454286 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591342 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00452943 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00452943 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: /model.69/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00573422 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603391 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00572252 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00572252 [04/18/2023-13:39:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:33] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) long-strided -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00317928 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603505 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026442 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0026442 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) long-strided -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00406095 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612647 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00407657 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00406095 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) long-strided -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00314395 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600152 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00312815 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00312815 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) long-strided -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00415504 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060661 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249253 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249253 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) long-strided -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00381113 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611314 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00378478 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00378478 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) long-strided -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00312636 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597181 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238217 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238217 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267733 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0226495 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268419 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00267733 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00315786 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593298 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00264279 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00264279 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00417411 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617124 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0041408 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0041408 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00335872 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010478 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00364263 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00335872 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00343216 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010658 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00313441 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00313441 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00412761 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100788 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00320203 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00320203 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038169 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010641 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00383362 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0038169 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00352725 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107938 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00328374 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00328374 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00431153 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010098 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00326348 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00326348 [04/18/2023-13:39:33] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.70/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00481554 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00737714 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265151 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00265151 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.70/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00434313 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616876 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00433856 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00433856 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.70/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00314395 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00731954 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00313103 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00313103 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.70/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00433842 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609371 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250223 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250223 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.70/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00381582 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618591 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00381101 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00381101 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.70/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00311115 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606209 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236897 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236897 [04/18/2023-13:39:33] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0100617 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00829968 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0100876 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00829968 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0114978 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00646619 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0114556 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00646619 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0180794 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00651428 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0180057 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00651428 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Float(1:4,1600,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0243474 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0200777 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0236709 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0200777 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00320975 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0065093 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00669257 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00320975 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00609124 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00784938 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00416183 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00416183 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0105189 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600114 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00448414 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00448414 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0105368 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609352 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0105208 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00609352 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0135697 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603467 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0135543 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00603467 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(1:8,1600,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0327973 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.019864 [04/18/2023-13:39:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0150373 [04/18/2023-13:39:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0150373 [04/18/2023-13:39:33] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(408000:32,1600,40,1) *************** [04/18/2023-13:39:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.761911 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0809691 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.754103 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0809691 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Float(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0131092 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0325303 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0112552 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0112552 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0113976 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0331995 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0112091 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0112091 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0228846 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0323566 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0228134 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0228134 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Float(1:4,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0428983 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0332562 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0427886 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0332562 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0110878 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0334985 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0111335 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0110878 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00900429 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00795632 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00899686 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00795632 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00659179 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604762 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00661943 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00604762 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(25600,1:16,640,16) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00660634 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00628611 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00659075 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00628611 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0186194 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611067 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0186137 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00611067 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(1:8,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0499611 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0210024 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0500297 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0210024 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(408000:32,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.761225 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0715268 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.775607 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0715268 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Float(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00842272 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00751904 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00843294 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00751904 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Float(408000,1,10200,255) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00624576 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00840444 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00626425 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00624576 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0227997 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00655273 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0227951 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00655273 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Float(1:4,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0431817 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0216411 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0433211 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0216411 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00830248 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675345 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00829257 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00675345 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00887476 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00795352 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00884867 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00795352 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00734491 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00734583 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00608 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(25600,1:16,640,16) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00727977 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605848 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00731314 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00605848 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0182337 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611257 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0182714 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00611257 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(1:8,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.050371 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0209332 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0503695 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0209332 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(408000:32,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.763026 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0721189 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.748983 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0721189 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00831264 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00760854 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00829435 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00760854 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00642882 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0085924 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00639662 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00639662 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00806679 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00825321 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00802895 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00802895 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Float(1:4,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0434011 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0223327 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0430446 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0223327 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00822425 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00696294 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00823111 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00696294 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00841519 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00805206 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00846467 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00805206 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00739794 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592622 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00736137 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00592622 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00740686 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594505 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00735291 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00594505 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0174207 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600743 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0174202 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00600743 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(1:8,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.049533 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0209358 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0496396 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0209358 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(408000:32,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.756297 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0717531 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.76288 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0717531 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.014368 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.167058 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0143461 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0143461 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0146624 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.167643 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0146469 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0146469 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0153989 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.168814 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0153874 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0153874 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0195291 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.16896 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0194389 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0194389 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0131175 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0868937 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0131923 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0131175 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0133062 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0808686 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0132966 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0132966 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0139408 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0801509 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0138203 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0138203 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.013809 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.080256 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0143698 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.013809 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0145184 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.080144 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0144389 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0144389 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(1:8,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0412526 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0876251 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0411463 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0411463 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(408000:32,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.773851 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0765806 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.76405 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0765806 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00881936 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0312366 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0107631 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00881936 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0117356 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0346149 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0111947 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0111947 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0118734 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0344238 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0123284 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0118734 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0181577 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0300754 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0181211 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0181211 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Float(1:4,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0223687 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0812617 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0218664 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0218664 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00691788 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0162413 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00563165 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00563165 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0101681 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0163413 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00469338 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00469338 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0101598 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0141652 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0101516 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0101516 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0135372 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117693 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0135335 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0117693 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Half(1:8,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0323383 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0197109 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.014667 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.014667 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Half(408000:32,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.759077 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0553295 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.752494 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0553295 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0151383 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.051901 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0153545 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0151383 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0193051 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0501699 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.014421 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.014421 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0170829 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0297847 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0133157 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0133157 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0182806 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0241272 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0182891 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0182806 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Float(1:4,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0413989 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0821394 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0415086 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0413989 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00581394 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0142562 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409417 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00409417 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00759699 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010542 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345709 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00345709 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00760686 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105652 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00760012 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00760012 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0135609 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104271 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.013521 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0104271 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(1:8,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0487954 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0238156 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0485669 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0238156 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(408000:32,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.73728 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0581242 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.761563 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0581242 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Float(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0134645 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0496396 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0139001 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0134645 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Float(408000,1,10200,255) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0174354 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0404114 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0146094 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0146094 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0167335 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0521204 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0142935 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0142935 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0222459 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0267756 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0222824 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0222459 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Float(1:4,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0424937 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0818469 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0416149 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0416149 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00829156 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0204206 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00580718 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00580718 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00820013 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0158185 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00392933 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00392933 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(25600,1:16,640,16) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00712708 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00847381 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00706656 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00706656 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0175517 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00756884 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.017538 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00756884 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(1:8,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0486644 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0216013 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0492876 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0216013 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(408000:32,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.758729 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0574476 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.740352 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0574476 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Float(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0110133 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0326199 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0111705 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0110133 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Float(408000,1,10200,255) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0106717 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0324462 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0113442 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0106717 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0110263 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0330606 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0113632 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0110263 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0223112 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0221917 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0222354 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0221917 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Float(1:4,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0415783 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0819314 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0422434 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0415783 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Half(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00819124 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0168513 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00797181 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00797181 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00815568 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0168051 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00974263 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00815568 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0103304 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0272084 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00828216 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00828216 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0175136 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0206302 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0175076 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0175076 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Half(1:8,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0486156 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0214407 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0489082 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0214407 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Half(408000:32,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.754103 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0572952 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.748251 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0572952 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00800914 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0157051 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00796851 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00796851 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00666182 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.016861 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00674078 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00666182 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00790111 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0149778 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00791026 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00790111 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0199863 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0172109 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0200389 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0172109 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(1:4,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0416857 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0820709 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0416926 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0416857 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00790568 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173938 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00787633 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00787633 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.007952 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0162702 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00797003 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.007952 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00712403 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0148434 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00707222 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00707222 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00708158 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0132343 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00707657 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00707657 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(1:8,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0484693 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0216829 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0484282 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0216829 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(408000:32,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.762002 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0573592 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.749129 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0573592 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0143493 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0574903 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0140077 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0140077 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0146743 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0588541 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0147209 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0146743 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0154322 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.059037 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0154551 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0154322 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0194749 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0588069 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0195109 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0194749 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Float(1:4,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0338021 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0947931 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0330021 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0330021 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0130714 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.260827 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0161036 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0130714 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.017345 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.256146 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0151529 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0151529 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0170992 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.255122 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0157554 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0157554 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0174705 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.255269 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0158725 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0158725 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0194194 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.255415 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0162016 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0162016 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Half(408000:32,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.766976 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0773074 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.756736 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0773074 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0244343 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0579779 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0245029 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0244343 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.039424 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0595535 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0393143 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0393143 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0393931 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0596358 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0392389 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0392389 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0276739 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.063136 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0273303 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0273303 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Float(1:4,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0428731 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.097152 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.042192 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.042192 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0234233 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.262875 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0230511 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0230511 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0230472 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.259072 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0232496 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0230472 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0382171 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.258048 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0380366 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0380366 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0379714 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.258194 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0382217 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0379714 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0240312 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.258341 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.023917 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.023917 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Half(1:8,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.051072 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0326254 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0511025 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0326254 [04/18/2023-13:39:34] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0109492 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0304832 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0110477 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0109492 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Float(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0106116 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0292791 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00873439 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00873439 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(25600,1:16,640,16) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Float(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Float(408000,1,10200,255) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00862037 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0239817 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0077286 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0077286 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(25600,1:16,640,16) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00773149 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0178651 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00734194 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00734194 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0138597 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0800914 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0137962 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0137962 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Half(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0101723 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0136453 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.010165 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.010165 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00760758 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012093 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00761143 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00760758 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:4,2560,64) -> Float(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00817702 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109793 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00818286 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00817702 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:4,2560,64) -> Float(408000,1,10200,255) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00635627 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107644 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00634395 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00634395 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:4,2560,64) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00781522 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107873 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00788211 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00781522 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:4,2560,64) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0222733 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105861 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0222237 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0105861 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:4,2560,64) -> Half(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00792301 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0129131 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00791435 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00791435 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:4,2560,64) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00822222 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010833 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00821359 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00821359 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:4,2560,64) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00706874 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108124 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00705611 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00705611 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:4,2560,64) -> Half(25600,1:16,640,16) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00707657 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108607 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0070744 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0070744 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:4,2560,64) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0174623 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107406 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0175045 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0107406 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Float(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Float(408000,1,10200,255) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00711467 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109691 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00706286 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00706286 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(25600,1:16,640,16) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Float(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Float(408000,1,10200,255) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Half(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Half(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00705067 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108473 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00707461 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00705067 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00706133 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107791 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00711162 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00706133 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Half(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0137546 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.254976 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0148645 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0137546 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Half(102400,1:4,2560,64) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.03796 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.258469 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0379486 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0379486 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:39:34] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0102664 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0266537 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00786478 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00786478 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00839619 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0207445 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00707636 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00707636 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.054077 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0169214 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0540693 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0169214 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344272 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108291 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00667969 [04/18/2023-13:39:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00344272 [04/18/2023-13:39:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00616971 [04/18/2023-13:39:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107079 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00413806 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00413806 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00643657 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109015 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00396602 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00396602 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0064322 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106642 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00398603 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00398603 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00689437 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114328 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00687978 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00687978 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0263604 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106348 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0263314 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0106348 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00820038 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00920886 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00806552 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00806552 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00624258 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0085717 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00624218 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00624218 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.058109 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00801803 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0582217 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00801803 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00801219 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00731703 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00798349 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00731703 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00841869 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00781618 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0084437 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00781618 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00623205 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00680337 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00626564 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00623205 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00626623 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676655 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00623543 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00623543 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00669382 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00678899 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00670504 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00669382 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0304567 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00708528 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0305271 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00708528 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00843213 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00918943 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00838172 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00838172 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00626882 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00859375 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00626683 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00626683 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0582263 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00794108 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0581242 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00794108 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00844101 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00756619 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00840471 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00756619 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00886965 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00784457 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00891025 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00784457 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00704588 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00679958 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00708942 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00679958 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00708027 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006768 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00706242 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.006768 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00747063 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006816 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00746263 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.006816 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.030496 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00653008 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0304274 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00653008 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0083073 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00922514 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00832457 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0083073 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00626425 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0085475 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00626425 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00626425 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00705328 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00858138 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00706373 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00705328 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00830527 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00774039 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00830629 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00774039 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00861311 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00771489 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00860531 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00771489 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0070744 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00678151 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0070548 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00678151 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00708223 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00678442 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00705633 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00678442 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00746834 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00680316 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0074736 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00680316 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0300827 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00643776 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0300763 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00643776 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00312089 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011116 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00657621 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00312089 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00595619 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109675 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00598095 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00595619 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00645068 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110133 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00643737 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00643737 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0539352 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100642 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0539307 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0100642 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00583223 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109783 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00417162 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00417162 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0061379 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0131886 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00397054 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00397054 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00615067 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109394 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00395737 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00395737 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00658618 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109189 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00659429 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00658618 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0262072 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110006 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0262827 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0110006 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00622032 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108862 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409822 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00409822 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00639105 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107726 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00639901 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00639105 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00715132 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100547 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00714834 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00714834 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.054077 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00672457 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0543208 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00672457 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0058006 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0150807 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00410527 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00410527 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00682166 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0069834 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00682993 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00682166 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00680925 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00696142 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00370462 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00370462 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00729211 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00699015 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00724046 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00699015 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0211461 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675179 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0211631 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00675179 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00776613 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00766725 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0077517 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00766725 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00635428 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675782 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00638708 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00635428 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00715337 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00706068 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0071064 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00706068 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0564571 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00656312 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0564236 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00656312 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00765209 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0145687 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00761287 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00761287 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00796749 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00769203 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00796521 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00769203 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00680903 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00683102 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00681818 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00680903 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00722949 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00683799 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00725349 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00683799 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0285842 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00652343 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0285501 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00652343 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00775651 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00766821 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00338817 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00338817 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00637217 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676114 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00637376 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00637217 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00713491 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676696 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00711837 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00676696 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0562865 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00653569 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0563672 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00653569 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00764535 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0147131 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00322651 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00322651 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00795835 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00768048 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.003 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.003 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00680208 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00680533 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00682449 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00680208 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00724137 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00681056 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00721714 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00681056 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0285925 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0065681 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0286089 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0065681 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00775218 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00758039 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00774977 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00758039 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00635588 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673081 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0063515 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0063515 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00714537 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677049 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00714492 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00677049 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0565257 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00659595 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.056515 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00659595 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00767783 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0146167 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00766677 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00766677 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00804572 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0078311 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00805994 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0078311 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00681121 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677444 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00683211 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00677444 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00680795 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00680838 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00683342 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00680795 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0289902 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00655377 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0289637 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00655377 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00792325 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00756379 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00795784 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00756379 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00637833 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00725006 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00639344 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00637833 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00713252 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100346 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00715154 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00713252 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0557836 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00828343 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0557486 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00828343 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00784457 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0144297 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00783591 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00783591 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00532233 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00794108 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00531031 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00531031 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00683189 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00874407 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0068295 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0068295 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0068123 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00683211 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00680882 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00680882 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00722949 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00678483 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0072368 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00678483 [04/18/2023-13:39:35] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00321168 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00632865 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00669735 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00321168 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00609467 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00862736 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00417306 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00417306 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00647473 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0066986 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00396726 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00396726 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0080861 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00921514 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00807797 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00807797 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00800356 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00774111 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00800838 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00774111 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00845311 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00781041 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00842353 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00781041 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00626027 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675325 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0062724 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00626027 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00841519 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00923514 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00840363 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00840363 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00840406 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00729714 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00842111 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00729714 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00886104 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00775001 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00885136 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00775001 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00703804 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00754863 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00705633 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00703804 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00835378 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00921686 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00834794 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00834794 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00834032 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00773774 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00832864 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00773774 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00856847 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00774617 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00860719 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00774617 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00708267 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00685388 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00707418 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00685388 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00307064 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00654712 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00655231 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00307064 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0058134 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00627101 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00415073 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00415073 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00614305 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00623304 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039675 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0039675 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00621575 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00769155 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409064 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00409064 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0057984 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0150528 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00410279 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00410279 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00680577 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110942 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00369383 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00369383 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00775723 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112123 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00776469 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00775723 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00763862 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.014544 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00765305 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00763862 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00790063 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112577 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00796013 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00790063 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00679771 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113871 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00680729 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00679771 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0077452 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110217 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00366347 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00366347 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00766412 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0146711 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00358514 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00358514 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00793792 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011156 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00338126 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00338126 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00778394 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110861 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00775314 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00775314 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0076326 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0146103 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00766268 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0076326 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00804292 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106932 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0080386 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0080386 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00679813 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108268 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00681099 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00679813 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00792517 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107353 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00795276 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00792517 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00780223 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0144251 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00785468 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00780223 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00530404 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012509 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00531403 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00530404 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00682123 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110361 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00681752 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00681752 [04/18/2023-13:39:35] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) long-strided -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00586642 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108042 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00584905 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00584905 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) long-strided -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0063674 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107892 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00639185 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0063674 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) long-strided -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0532602 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114599 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0515901 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0114599 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) long-strided -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00546184 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109244 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00550523 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00546184 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) long-strided -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00595257 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105208 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00596876 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00595257 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) long-strided -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0063839 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100876 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00635707 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00635707 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) long-strided -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00633143 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00999284 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00634137 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00633143 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) long-strided -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0067547 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100663 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00674556 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00674556 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) long-strided -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.025472 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00999131 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0254293 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00999131 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) long-strided -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00573733 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102674 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00551982 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00551982 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) long-strided -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00584229 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00718743 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00583132 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00583132 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) long-strided -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00632527 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00718606 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00636164 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00632527 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) long-strided -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0515901 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00755008 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0516358 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00755008 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) long-strided -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00578085 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00706765 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0057152 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0057152 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) long-strided -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00601829 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0127082 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00601676 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00601676 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) long-strided -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00601314 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675969 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00606495 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00601314 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) long-strided -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00642783 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00997333 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00643677 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00642783 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) long-strided -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0252929 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107063 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.025283 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0107063 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) long-strided -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00611409 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107553 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00610743 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00610743 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) long-strided -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00624576 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00991969 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00625014 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00624576 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) long-strided -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00699668 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00752069 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00700974 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00699668 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) long-strided -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0518827 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00738857 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0518446 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00738857 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) long-strided -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00577225 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0153454 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00576494 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00576494 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) long-strided -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00666036 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0075917 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00668675 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00666036 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) long-strided -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00666597 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00767928 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00666473 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00666473 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) long-strided -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00710357 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00755801 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00706874 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00706874 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) long-strided -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0203823 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00720206 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0204369 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00720206 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) long-strided -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00744137 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00821689 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00743657 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00743657 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) long-strided -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00624318 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00669174 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00631453 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00624318 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) long-strided -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00697078 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0066799 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00700299 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0066799 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) long-strided -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0537356 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00713012 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0538331 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00713012 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) long-strided -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00725166 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0148187 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00725646 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00725166 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) long-strided -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00771753 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00866958 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00773582 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00771753 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) long-strided -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00665933 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112091 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00664062 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00664062 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) long-strided -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00706199 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110351 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00703521 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00703521 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) long-strided -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0275238 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103112 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0274773 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0103112 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(388800,129600,3240,81,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00541934 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011252 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00543814 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00541934 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(388800,129600,3240,81,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00586423 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107847 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00584777 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00584777 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(388800,129600,3240,81,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00643657 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108248 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00645048 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00643657 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(388800,129600,3240,81,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.051619 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010543 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0515992 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.010543 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(388800,129600,3240,81,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00547708 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112056 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00550365 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00547708 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(388800,129600,3240,81,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00593408 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107843 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00595314 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00593408 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(388800,129600,3240,81,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00637496 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108875 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00636939 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00636939 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(388800,129600,3240,81,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00637635 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107905 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00639761 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00637635 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(388800,129600,3240,81,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00667782 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107892 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0067121 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00667782 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Float(388800,129600,3240,81,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0253806 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107912 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0253981 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0107912 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(388800,129600,3240,81,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00556431 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111877 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00553547 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00553547 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(388800,129600,3240,81,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00583113 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108212 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00584174 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00583113 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(388800,129600,3240,81,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00634077 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109864 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00632845 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00632845 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(388800,129600,3240,81,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0515642 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106358 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0515688 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0106358 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(388800,129600,3240,81,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00529642 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.014955 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00529676 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00529642 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(388800,129600,3240,81,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00575689 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010946 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00573879 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00573879 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(388800,129600,3240,81,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00604705 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0125973 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00604686 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00604686 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(388800,129600,3240,81,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00604381 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109058 [04/18/2023-13:39:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00603124 [04/18/2023-13:39:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00603124 [04/18/2023-13:39:35] [V] [TRT] *************** Autotuning Reformat: Half(388800,129600,3240,81,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00644532 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109006 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0064318 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0064318 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(388800,129600,3240,81,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0252571 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110027 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0252549 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0110027 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,3240:2,81,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00608114 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106292 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00610267 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00608114 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,3240:2,81,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00626405 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00980358 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00626922 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00626405 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,3240:2,81,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00699189 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00757101 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00699908 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00699189 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,3240:2,81,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0517257 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00723429 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0517714 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00723429 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,3240:2,81,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00576329 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0153879 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00573257 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00573257 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,3240:2,81,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00373779 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00890138 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00372806 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00372806 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,3240:2,81,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00665018 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00758448 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00668904 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00665018 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,3240:2,81,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.006688 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00752289 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00667055 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00667055 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,3240:2,81,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00706656 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00752385 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00707113 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00706656 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,3240:2,81,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0203514 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00725966 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0203874 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00725966 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1:8,405,5) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0074832 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0083327 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00751177 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0074832 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1:8,405,5) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00624378 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00672499 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00623523 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00623523 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1:8,405,5) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00697774 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00678774 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00698667 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00678774 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1:8,405,5) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0536381 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00703826 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0535695 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00703826 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1:8,405,5) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00726468 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0148475 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00723223 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00723223 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1:8,405,5) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00771056 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0086123 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00769853 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00769853 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1:8,405,5) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00663522 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676904 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00667075 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00663522 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1:8,405,5) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0066454 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00674286 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00666909 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0066454 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1:8,405,5) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00705241 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676883 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00705829 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00676883 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1:8,405,5) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0274118 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00704501 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0274453 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00704501 [04/18/2023-13:39:36] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.70/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00319868 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590537 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00264594 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00264594 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.70/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00311602 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595676 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237744 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237744 [04/18/2023-13:39:36] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-13:39:36] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252928 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0061499 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252391 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252391 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254901 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615257 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253578 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00253578 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00427872 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612933 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00427845 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00427845 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248883 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597505 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252279 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00248883 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00199733 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00644154 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241951 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00199733 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00245145 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610571 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00207795 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00207795 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0028949 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00986849 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00229116 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00229116 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00262907 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602419 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00264652 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00262907 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00304973 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00795048 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00299505 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00299505 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251541 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00620114 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00225129 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00225129 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0075378 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608952 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00750446 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00608952 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00263481 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00920943 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255257 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00255257 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00244974 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00625391 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244517 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00244517 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00518663 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609181 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00427146 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00427146 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00276158 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00686846 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269999 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00269999 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00255788 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00806019 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00257029 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00255788 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254204 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00632109 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254083 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00254083 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00608567 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0392937 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0108666 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00608567 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(720,240,1:16,6,3) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0112056 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.037368 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0115337 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0112056 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0105091 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0321957 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0121463 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0105091 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0110259 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0338176 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0113825 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0110259 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0130838 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0452046 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0117542 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0117542 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00975939 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0369451 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0112731 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00975939 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(9600,3200,1,80,40) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0114451 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0232934 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00806552 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00806552 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0064151 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0207935 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00563921 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00563921 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00480152 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0169854 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00501565 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00480152 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00592786 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0153559 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00330473 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00330473 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00317948 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00865264 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00361154 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00317948 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00337712 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00751543 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00263148 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00263148 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(720,240,1:16,6,3) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00258718 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00668405 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250207 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250207 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00305118 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00738583 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00301486 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00301486 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00278259 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0067894 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00277943 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00277943 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00752361 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0067759 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00750263 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0067759 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00260813 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00633262 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00262192 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00260813 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243921 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626325 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244269 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00243921 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247969 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00627259 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247905 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00247905 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00288658 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00836267 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0029495 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00288658 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00261968 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00627637 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266667 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00261968 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266142 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601029 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00274113 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266142 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252142 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00734834 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025418 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00252142 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252863 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607333 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00256339 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00252863 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00309972 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618324 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00299657 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00299657 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00282774 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00669174 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283464 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00282774 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00754478 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0067946 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00755657 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0067946 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248079 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604533 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248166 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00248079 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267479 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00682601 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268004 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00267479 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269113 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00683777 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271327 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00269113 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00391858 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00681165 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00392216 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00391858 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025529 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592256 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024789 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0024789 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00261253 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00671543 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00261403 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00261253 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00278547 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00819149 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00274571 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00274571 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00275473 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00687978 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00273699 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00273699 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00304165 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00684691 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00307754 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00304165 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00401676 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109162 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00428007 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00401676 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00754719 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105398 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00755801 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00754719 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00283375 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112542 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00423771 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00283375 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00319096 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618743 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00372513 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00319096 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00384722 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00896686 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00325797 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00325797 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00417358 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604152 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00418769 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00417358 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249986 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00783567 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00374295 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00249986 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238438 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616133 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00208298 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00208298 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247346 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00724985 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00313719 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00247346 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00360869 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0224774 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00319868 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00319868 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00289079 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0300983 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00325164 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00289079 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00354119 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103112 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00304564 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00304564 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00751246 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0123974 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00753371 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00751246 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00348655 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00908343 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00273492 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00273492 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00276862 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060619 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00264162 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00264162 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00519706 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105228 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253017 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00253017 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00413897 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00689849 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00412499 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00412499 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00277134 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011654 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.014318 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00277134 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240556 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614286 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00204813 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00204813 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00291429 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100584 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00291984 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00291429 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00317572 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611733 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249726 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249726 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00516408 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0163449 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00387744 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00387744 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00315776 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114588 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00316432 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00315776 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00742354 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0415351 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00750034 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00742354 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00337946 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00733143 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0021006 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0021006 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(9600,3200,1,80,40) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00245641 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609047 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00311013 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00245641 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0035433 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0656823 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250144 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250144 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00411285 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610495 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00413296 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00411285 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00328135 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.027062 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271457 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00271457 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250231 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606248 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00208788 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00208788 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033886 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0252409 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00207828 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00207828 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(720,240,1:16,6,3) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246629 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00620495 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00285151 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00246629 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00456686 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101321 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00310001 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00310001 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00306305 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115376 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00317396 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00306305 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00750286 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0136574 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00747337 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00747337 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00451443 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00907914 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254188 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00254188 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(9600,3200,1,80,40) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024485 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606152 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243254 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00243254 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246881 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00861741 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00512424 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00246881 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00363874 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100224 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.003616 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.003616 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00276062 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00666868 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272371 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00272371 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00289033 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611752 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251942 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251942 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253538 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611943 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025631 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00253538 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00263605 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00769058 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246936 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246936 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00285842 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00623821 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00286875 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00285842 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00272242 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010782 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00376385 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00272242 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00740846 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00700452 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00741897 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00700452 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025671 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601657 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255853 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00255853 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0036544 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0143611 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00315796 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00315796 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00313749 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100952 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00317643 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00313749 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00366488 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626266 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00367555 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00366488 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00369934 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00678629 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00274122 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00274122 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252904 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00627856 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253386 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00252904 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252439 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0131113 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240084 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240084 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024217 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601391 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244114 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0024217 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246826 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0086798 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00462054 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00246826 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00314713 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115225 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00311026 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00311026 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00741097 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00680991 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00743977 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00680991 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252335 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00674078 [04/18/2023-13:39:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00329101 [04/18/2023-13:39:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00252335 [04/18/2023-13:39:36] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-13:39:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00275622 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00672166 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267666 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00267666 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270128 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00662275 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0027535 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00270128 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.003976 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00668779 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00414916 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.003976 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251292 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605048 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025284 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00251292 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024554 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601105 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00208576 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00208576 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254123 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00672125 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254861 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00254123 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0026869 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00671044 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267683 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00267683 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267412 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00671065 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268495 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00267412 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00304399 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673974 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00304467 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00304399 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00752433 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600838 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00755056 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00600838 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00261004 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596743 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265854 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00261004 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269835 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00669964 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00277802 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00269835 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0027556 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00674473 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0027571 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0027556 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00429472 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00668613 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00435906 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00429472 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00276211 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596324 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253378 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00253378 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00255976 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622171 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255829 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00255829 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268902 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00679834 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026786 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0026786 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269096 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00674681 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270292 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00269096 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271086 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006736 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271802 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00271086 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00310976 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00682014 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00311632 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00310976 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249111 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593426 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250627 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00249111 [04/18/2023-13:39:37] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,80,2,1) -> Float(3200,3200,1,80,40) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238095 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616267 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238446 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238095 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,80,2,1) -> Float(800,800,1:4,20,10) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240069 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614628 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239977 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239977 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,80,2,1) -> Float(160,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0028411 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601143 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00284325 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0028411 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238331 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598267 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238956 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238331 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,80,2,1) -> Half(3200,3200,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00193273 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629048 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239771 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00193273 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,80,2,1) -> Half(1600,1600,80:2,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235151 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618724 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00205427 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00205427 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,80,2,1) -> Half(400,400,1:8,10,5) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239147 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595657 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240465 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239147 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,80,2,1) -> Half(240,240,1:16,6,3) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239749 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593298 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024128 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239749 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,80,2,1) -> Half(160,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252696 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600172 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247109 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00247109 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024633 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605753 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00225336 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00225336 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00764487 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618057 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0076634 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00618057 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1,80,40) -> Float(3200,3200,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239025 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631473 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236335 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236335 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1,80,40) -> Float(800,800,1:4,20,10) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233895 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00624556 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235384 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00233895 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1,80,40) -> Float(160,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00286226 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609543 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283796 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00283796 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1,80,40) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00256416 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00688849 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266878 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00256416 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1,80,40) -> Half(3200,3200,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023716 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603733 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238895 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0023716 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1,80,40) -> Half(1600,1600,80:2,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240853 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602324 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240457 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240457 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1,80,40) -> Half(400,400,1:8,10,5) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233681 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0061059 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234544 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00233681 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1,80,40) -> Half(240,240,1:16,6,3) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235541 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234439 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234439 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1,80,40) -> Half(160,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252255 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608914 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253225 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00252255 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1,80,40) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267632 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00674099 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266955 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00266955 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1,80,40) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00772403 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00684321 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00772932 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00684321 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1:4,20,10) -> Float(3200,3200,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239078 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00633242 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239322 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239078 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1:4,20,10) -> Float(3200,3200,1,80,40) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234664 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629645 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023704 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234664 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1:4,20,10) -> Float(160,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00284119 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610667 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0028419 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00284119 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1:4,20,10) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00256335 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00682123 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255967 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00255967 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1:4,20,10) -> Half(3200,3200,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239299 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607448 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241318 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239299 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1:4,20,10) -> Half(1600,1600,80:2,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242004 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592859 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242418 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00242004 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1:4,20,10) -> Half(400,400,1:8,10,5) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236987 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00756066 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023653 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0023653 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1:4,20,10) -> Half(240,240,1:16,6,3) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236103 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600457 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023677 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236103 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1:4,20,10) -> Half(160,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025631 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00579438 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255992 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00255992 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1:4,20,10) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266548 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00666868 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267666 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266548 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1:4,20,10) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0077197 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00663418 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0077197 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00663418 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(160,160,80:32,2,1) -> Float(3200,3200,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243564 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631096 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00327834 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00243564 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(160,160,80:32,2,1) -> Float(3200,3200,1,80,40) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233895 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622529 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235608 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00233895 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(160,160,80:32,2,1) -> Float(800,800,1:4,20,10) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236425 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00625093 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235976 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235976 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(160,160,80:32,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00261378 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00670732 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00261561 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00261378 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(160,160,80:32,2,1) -> Half(3200,3200,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00261652 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616857 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243812 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00243812 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(160,160,80:32,2,1) -> Half(1600,1600,80:2,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247322 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607867 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247519 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00247322 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(160,160,80:32,2,1) -> Half(400,400,1:8,10,5) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237032 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599695 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236193 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236193 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(160,160,80:32,2,1) -> Half(240,240,1:16,6,3) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237924 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600667 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239071 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237924 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(160,160,80:32,2,1) -> Half(160,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00255829 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602629 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253626 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00253626 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(160,160,80:32,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00274458 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006752 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270991 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00270991 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(160,160,80:32,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00773847 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0068062 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00771224 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0068062 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(3200,3200,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023728 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613886 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236388 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236388 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(3200,3200,1,80,40) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250112 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00679896 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250996 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00250112 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(800,800,1:4,20,10) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252824 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00683037 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025345 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00252824 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(160,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00296275 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00683842 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00296256 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00296256 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(3200,3200,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235856 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006196 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235856 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235856 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(1600,1600,80:2,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246439 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673787 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245594 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00245594 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(400,400,1:8,10,5) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253594 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677901 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254885 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00253594 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(240,240,1:16,6,3) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253915 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00699385 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255086 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00253915 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(160,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00260829 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677278 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00261212 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00260829 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254188 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608457 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025106 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0025106 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00764391 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609981 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00772716 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00609981 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200,80,2,1) -> Float(3200,3200,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0019313 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00625312 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00211348 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0019313 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200,80,2,1) -> Float(3200,3200,1,80,40) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238362 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602343 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238324 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238324 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200,80,2,1) -> Float(800,800,1:4,20,10) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239124 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616076 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240823 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239124 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200,80,2,1) -> Float(160,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0028928 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613581 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00290816 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0028928 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237714 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619314 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239589 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237714 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200,80,2,1) -> Half(1600,1600,80:2,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235474 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621973 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00202385 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00202385 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200,80,2,1) -> Half(400,400,1:8,10,5) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235751 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0063195 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00225307 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00225307 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200,80,2,1) -> Half(240,240,1:16,6,3) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236425 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621496 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237137 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236425 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200,80,2,1) -> Half(160,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243835 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062231 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247913 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00243835 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239429 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00627737 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00224507 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00224507 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00766244 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00632984 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00763741 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00632984 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,80:2,2,1) -> Float(3200,3200,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235706 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619124 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00197079 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00197079 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,80:2,2,1) -> Float(3200,3200,1,80,40) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237789 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603105 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237752 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237752 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,80:2,2,1) -> Float(800,800,1:4,20,10) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247701 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606476 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241951 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00241951 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,80:2,2,1) -> Float(160,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00290066 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601581 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00289344 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00289344 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,80:2,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249419 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00670192 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250152 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00249419 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,80:2,2,1) -> Half(3200,3200,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023116 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617867 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00196621 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00196621 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,80:2,2,1) -> Half(400,400,1:8,10,5) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238164 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615448 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00220329 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00220329 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,80:2,2,1) -> Half(240,240,1:16,6,3) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023722 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605505 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239619 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0023722 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,80:2,2,1) -> Half(160,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024826 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006076 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246786 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246786 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,80:2,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025454 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676239 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254131 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00254131 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,80:2,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00765642 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00683755 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00762562 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00683755 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(400,400,1:8,10,5) -> Float(3200,3200,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237572 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599029 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00208543 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00208543 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(400,400,1:8,10,5) -> Float(3200,3200,1,80,40) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023665 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605371 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236523 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236523 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(400,400,1:8,10,5) -> Float(800,800,1:4,20,10) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238446 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613067 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237572 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237572 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(400,400,1:8,10,5) -> Float(160,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00289838 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597314 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00290569 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00289838 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(400,400,1:8,10,5) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254204 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00668925 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255355 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00254204 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(400,400,1:8,10,5) -> Half(3200,3200,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236305 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006096 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0020849 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0020849 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(400,400,1:8,10,5) -> Half(1600,1600,80:2,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023725 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0061141 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00208212 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00208212 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(400,400,1:8,10,5) -> Half(240,240,1:16,6,3) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234537 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00623662 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234454 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234454 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(400,400,1:8,10,5) -> Half(160,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250483 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0064479 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250152 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250152 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(400,400,1:8,10,5) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00258563 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00688653 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272681 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00258563 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(400,400,1:8,10,5) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00760926 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00690569 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00764704 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00690569 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(240,240,1:16,6,3) -> Float(3200,3200,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237707 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060461 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239368 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237707 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(240,240,1:16,6,3) -> Float(3200,3200,1,80,40) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234957 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006188 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236778 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234957 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(240,240,1:16,6,3) -> Float(800,800,1:4,20,10) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236313 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00620076 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238301 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236313 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(240,240,1:16,6,3) -> Float(160,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00288411 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606324 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0028864 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00288411 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(240,240,1:16,6,3) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00256841 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00689219 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00256384 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00256384 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(240,240,1:16,6,3) -> Half(3200,3200,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236778 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622768 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237287 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236778 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(240,240,1:16,6,3) -> Half(1600,1600,80:2,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238598 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626345 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237077 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237077 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(240,240,1:16,6,3) -> Half(400,400,1:8,10,5) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00260305 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00650826 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233865 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00233865 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(240,240,1:16,6,3) -> Half(160,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250128 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00632387 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00257494 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00250128 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(240,240,1:16,6,3) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00259714 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00714309 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265507 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00259714 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(240,240,1:16,6,3) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00759747 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00718041 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00765377 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00718041 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(160,160,80:32,2,1) -> Float(3200,3200,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242944 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614781 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242202 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00242202 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(160,160,80:32,2,1) -> Float(3200,3200,1,80,40) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237295 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00647493 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237797 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237295 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(160,160,80:32,2,1) -> Float(800,800,1:4,20,10) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240785 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606229 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239444 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239444 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(160,160,80:32,2,1) -> Float(160,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00283464 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00624 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00284074 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00283464 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(160,160,80:32,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254107 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00684996 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255486 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00254107 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(160,160,80:32,2,1) -> Half(3200,3200,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238522 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00636144 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239208 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238522 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(160,160,80:32,2,1) -> Half(1600,1600,80:2,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236186 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618476 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237917 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236186 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(160,160,80:32,2,1) -> Half(400,400,1:8,10,5) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233681 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622052 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234109 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00233681 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(160,160,80:32,2,1) -> Half(240,240,1:16,6,3) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235766 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00627518 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240251 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235766 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(160,160,80:32,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00262184 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00693268 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026309 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00262184 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(160,160,80:32,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00764174 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00685018 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00766412 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00685018 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(3200,3200,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023725 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604838 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00206426 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00206426 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(3200,3200,1,80,40) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252086 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0067626 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250191 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250191 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(800,800,1:4,20,10) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254372 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00686977 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252912 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252912 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(160,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00293374 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0068628 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00293598 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00293374 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246534 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622469 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244602 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00244602 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(3200,3200,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233718 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626226 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00206034 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00206034 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(1600,1600,80:2,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251573 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0070252 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241379 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00241379 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(400,400,1:8,10,5) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00272474 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00695684 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024949 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0024949 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(240,240,1:16,6,3) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254139 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00683037 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250538 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250538 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(160,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00255894 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00694923 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253706 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00253706 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00764872 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618781 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00766316 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00618781 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(3200,3200,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240808 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00620133 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240282 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240282 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(3200,3200,1,80,40) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00256245 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00690242 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253458 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00253458 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(800,800,1:4,20,10) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025871 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0068443 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253835 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00253835 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(160,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.002984 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00697469 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00295268 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00295268 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249553 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00633699 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255306 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00249553 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(3200,3200,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237834 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00641928 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242975 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237834 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(1600,1600,80:2,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251862 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00689611 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025272 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00251862 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(400,400,1:8,10,5) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00260979 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00681861 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00261976 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00260979 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(240,240,1:16,6,3) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00262433 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00695663 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00256718 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00256718 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(160,160,80:32,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0028039 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00687739 [04/18/2023-13:39:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268555 [04/18/2023-13:39:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00268555 [04/18/2023-13:39:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00265202 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062237 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00256172 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00256172 [04/18/2023-13:39:38] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(720,240,1:16,6,3) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(9600,3200,1,80,40) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(720,240,1:16,6,3) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(9600,3200,1,80,40) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(720,240,1:16,6,3) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(9600,3200,1,80,40) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:38] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00257118 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621197 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00281923 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00257118 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252343 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00662275 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253987 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00252343 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00259298 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0066427 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252712 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252712 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00358377 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00664894 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00361463 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00358377 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00258808 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00623821 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00258498 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00258498 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00264387 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605676 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265278 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00264387 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254532 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617867 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255174 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00254532 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252824 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00659013 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00363166 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00252824 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00417241 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113924 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00273803 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00273803 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00323393 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119558 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00494912 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00323393 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00362172 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105172 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039166 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00362172 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00386768 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110787 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409913 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00386768 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00440215 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0131782 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00492863 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00440215 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00384301 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010116 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00382941 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00382941 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00307988 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103184 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0103237 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00307988 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00300809 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010201 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00311106 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00300809 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00309612 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103572 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00321676 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00309612 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00301067 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110467 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00364681 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00301067 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00259518 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610324 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246392 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246392 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00308173 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586807 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00306752 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00306752 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269071 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588416 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266015 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00266015 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00245238 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00645923 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244796 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00244796 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251421 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00647791 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250771 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250771 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00391846 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00989592 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00381654 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00381654 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00275587 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604038 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0028082 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00275587 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269384 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602324 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026593 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0026593 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247795 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248875 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00247795 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253225 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605295 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247882 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00247882 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250309 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610114 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250562 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00250309 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00304875 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00628075 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00304642 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00304642 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268233 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589166 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00279262 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00268233 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246424 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00667948 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250755 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00246424 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025667 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00665642 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249088 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249088 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00364629 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00662525 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0036725 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00364629 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00274363 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604191 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267463 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00267463 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00273889 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586715 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026955 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0026955 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252656 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006096 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253859 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00252656 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250136 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00625511 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252054 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00250136 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00257429 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00655584 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00258621 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00257429 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00306821 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00576969 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00306101 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00306101 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0026378 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00713078 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270491 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0026378 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269164 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00680187 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00273751 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00269164 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00277099 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00684103 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0027012 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0027012 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00405613 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00684691 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039793 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0039793 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267522 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119752 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00264187 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00264187 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00273665 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00696316 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00275235 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00273665 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00273311 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00666306 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00274734 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00273311 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0027156 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00658306 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00276343 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0027156 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00273906 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00662961 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00275613 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00273906 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00303143 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00668177 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00301333 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00301333 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00257592 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619143 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00258506 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00257592 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251741 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596809 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250246 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250246 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251413 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594725 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252632 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00251413 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00361691 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587502 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00363291 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00361691 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253795 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00628989 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255804 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00253795 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00257396 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00659927 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025951 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00257396 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249261 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00658286 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247504 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00247504 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248851 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00658888 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250475 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00248851 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250751 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00660197 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250081 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250081 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00298276 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00774881 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00298248 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00298248 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00262267 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00579291 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00262201 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00262201 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250097 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582528 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251084 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00250097 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254669 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585088 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254139 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00254139 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00360811 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587282 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0036392 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00360811 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00258131 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594962 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00258278 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00258131 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239292 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584942 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239535 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239292 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248552 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610591 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024744 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0024744 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249963 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592238 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249529 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249529 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252712 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588014 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250554 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250554 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00277187 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059061 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00276527 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00276527 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267657 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582144 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267446 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00267446 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246129 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602476 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245742 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00245742 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250199 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603067 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267708 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00250199 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00367613 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00579913 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00370731 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00367613 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266362 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588654 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267099 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266362 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268216 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587959 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269198 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00268216 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00245052 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612095 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244773 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00244773 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025769 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608343 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244076 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00244076 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246253 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609733 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248694 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00246253 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00303314 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593353 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00305439 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00303314 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268707 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0065467 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267115 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00267115 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00245253 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616895 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244781 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00244781 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248221 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602152 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00263314 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00248221 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00402895 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058869 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00402552 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00402552 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00265609 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583058 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00291554 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00265609 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00307336 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00993676 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00301362 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00301362 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00303429 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102821 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00331605 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00303429 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00295202 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100919 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00305498 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00295202 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00317958 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101071 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00318771 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00317958 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00304438 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100044 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00342454 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00304438 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00297609 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0098115 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00296154 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00296154 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00264762 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00581595 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249553 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249553 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00259559 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590793 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025353 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0025353 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00373462 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621774 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.003729 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.003729 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00265041 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00641093 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268588 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00265041 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024893 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590245 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00258882 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0024893 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00244045 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603219 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00258237 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00244045 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025951 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591579 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252728 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252728 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250262 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586313 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248575 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248575 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00275077 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058646 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0030615 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00275077 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00350238 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104993 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00330431 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00330431 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00335128 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104722 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347679 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00335128 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00335766 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011891 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349547 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00335766 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00434951 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113632 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039906 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0039906 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00329756 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0180091 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00342977 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00329756 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325143 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115692 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0034813 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00325143 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00366857 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121592 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00402438 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00366857 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00374306 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119863 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00403594 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00374306 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00390795 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118762 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00411664 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00390795 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00386212 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0123196 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00400495 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00386212 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00373158 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112169 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00399721 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00373158 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0039014 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118748 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00404051 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0039014 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00394687 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0124286 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00406222 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00394687 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00405295 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011936 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00388819 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00388819 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038175 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0175619 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00382785 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0038175 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00389844 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119497 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039575 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00389844 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00401651 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120979 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00406324 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00401651 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00378851 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120282 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00381558 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00378851 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00389053 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119996 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00415869 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00389053 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00394255 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120232 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00394996 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00394255 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00382556 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011033 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00397765 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00382556 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00379176 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106942 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00394144 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00379176 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00386273 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107458 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00398667 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00386273 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00385588 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107004 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00394008 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00385588 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00385696 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106136 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00401562 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00385696 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0037908 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104718 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00393266 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0037908 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038299 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105554 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00402108 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0038299 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00369817 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104682 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00391808 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00369817 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00387768 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105176 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00400914 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00387768 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0037902 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105437 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00395317 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0037902 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00375478 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010511 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00392587 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00375478 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00387027 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110375 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00410423 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00387027 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00386903 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010959 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00410984 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00386903 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00366137 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107295 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00370075 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00366137 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00400229 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105531 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00405143 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00400229 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00379561 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105783 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00400749 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00379561 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.003925 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107889 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00399136 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.003925 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00376397 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107014 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00393921 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00376397 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00393995 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104999 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00405955 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00393995 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038477 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104967 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00397562 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0038477 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00374658 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010513 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00390622 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00374658 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00387064 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109022 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00399949 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00387064 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00396491 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110252 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00410932 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00396491 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00370731 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107416 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00369946 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00369946 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00384469 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106008 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00398755 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00384469 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00384626 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104735 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00401079 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00384626 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00395428 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108754 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00412513 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00395428 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00390066 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107527 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00399936 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00390066 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00406184 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106942 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00420397 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00406184 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00390227 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104748 [04/18/2023-13:39:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00397121 [04/18/2023-13:39:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00390227 [04/18/2023-13:39:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:38] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00362892 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104313 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00384445 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00362892 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00379982 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107033 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00394366 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00379982 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038412 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107288 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00398489 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0038412 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00383832 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106818 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039166 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00383832 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00379104 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105708 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00387805 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00379104 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00378057 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105012 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039255 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00378057 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00397181 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104722 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409691 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00397181 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00378983 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104581 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00394848 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00378983 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.003976 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105992 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00410096 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.003976 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038554 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103696 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00400622 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0038554 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00382677 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107517 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039339 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00382677 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00392834 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121417 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00399225 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00392834 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00395638 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120232 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00411167 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00395638 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00374295 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120811 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409469 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00374295 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038323 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119741 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00397714 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0038323 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00388077 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119623 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039807 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00388077 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00394502 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0124968 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00400394 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00394502 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00386792 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119577 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00396083 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00386792 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00405943 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119851 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0041886 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00405943 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00400762 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120945 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0041263 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00400762 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00386165 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010896 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039124 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00386165 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00395218 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105296 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00411102 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00395218 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00392537 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106403 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004032 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00392537 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00390276 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105829 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00403479 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00390276 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0039779 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109894 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00420921 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0039779 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00392105 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108356 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00404762 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00392105 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0039491 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109659 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00414302 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0039491 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00380884 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108513 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00395898 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00380884 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00397067 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108317 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00408503 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00397067 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00398603 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107696 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00413009 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00398603 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00356951 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104153 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00380487 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00356951 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00376806 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104366 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00386928 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00376806 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0037991 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105923 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00394885 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0037991 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00384493 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105143 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00395762 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00384493 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00380704 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106854 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00393859 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00380704 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00373087 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110129 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039313 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00373087 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00289298 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613086 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251461 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251461 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00295389 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00972587 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248355 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248355 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250883 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062241 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252311 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00250883 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00279051 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590519 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00284441 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00279051 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268038 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586222 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00280175 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00268038 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253626 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00628055 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254556 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00253626 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248954 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626246 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248449 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248449 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00363474 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604933 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00360594 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00360594 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268301 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614381 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026731 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0026731 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268732 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675803 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267801 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00267801 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00245122 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00682992 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242042 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00242042 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00244812 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626782 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00261943 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00244812 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.002443 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611924 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265312 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.002443 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00306538 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589367 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00300095 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00300095 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00293691 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585015 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00275286 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00275286 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249963 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601638 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245525 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00245525 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266861 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130772 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249293 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249293 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00365611 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594304 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00364526 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00364526 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270425 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603067 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272975 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00270425 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267759 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591525 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266599 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00266599 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00245122 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621178 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244331 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00244331 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00273423 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00674099 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241821 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00241821 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246313 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619124 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024651 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00246313 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00321361 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00774376 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00318893 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00318893 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266997 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587173 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268521 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266997 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247007 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00850489 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255951 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00247007 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00256416 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594505 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024971 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0024971 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00413571 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596724 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00416588 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00413571 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267099 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00625809 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026571 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0026571 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024841 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598286 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246503 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246503 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246676 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601638 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245253 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00245253 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00245587 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602495 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242952 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00242952 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00256433 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609543 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246276 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246276 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00276633 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00725943 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00275534 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00275534 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00265253 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01138 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265837 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00265253 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269308 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00670836 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268072 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00268072 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271094 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00801956 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00290642 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00271094 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00374635 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00668821 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00375643 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00374635 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00261619 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0174405 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00343347 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00261619 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266565 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00685301 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270215 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266565 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267242 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00713578 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268309 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00267242 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00273225 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00685562 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00292711 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00273225 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00275965 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673579 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268055 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00268055 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00310728 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00674327 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00301362 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00301362 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00274562 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00937914 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026987 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0026987 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271224 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0082714 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0029035 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00271224 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00275947 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00672748 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00276035 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00275947 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00418704 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677548 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00427872 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00418704 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0026626 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0174862 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266751 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0026626 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00273742 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00671688 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334304 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00273742 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0028203 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00692223 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269122 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00269122 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268792 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673579 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026941 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00268792 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00482133 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011995 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00403187 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00403187 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00401397 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120442 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00487993 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00401397 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00595429 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109309 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00592293 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00592293 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00655106 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108104 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00653735 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00653735 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0542095 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00818413 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0539307 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00818413 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0111072 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0325102 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0096448 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0096448 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0130435 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0567086 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.018435 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0130435 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0264038 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0388754 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0263726 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0263726 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0153979 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0509745 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0150587 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0150587 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0581242 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0354194 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.058173 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0354194 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00805841 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0134895 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00713143 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00713143 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00812876 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01916 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00762202 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00762202 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0304567 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0213322 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0314167 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0213322 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00633361 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00881398 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00624974 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00624974 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0582888 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103745 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.058173 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0103745 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00710814 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0150391 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00709812 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00709812 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00747886 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676634 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00745211 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00676634 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0305189 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00661818 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0304923 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00661818 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00627538 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00979688 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00626783 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00626783 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00706003 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00856471 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00703761 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00703761 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0070831 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0160644 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00705502 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00705502 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00748983 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00694748 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00747429 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00694748 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0300763 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00651345 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0300763 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00651345 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00598057 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00672125 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00595924 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00595924 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00644909 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673018 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00642743 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00642743 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0538255 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00797079 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0556861 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00797079 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.006144 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.013152 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00399924 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00399924 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00658888 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00783278 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00659179 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00658888 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0262514 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00895286 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0262309 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00895286 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0063994 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00918429 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00639205 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00639205 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00713622 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105593 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00716046 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00713622 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.054077 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00884652 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0540785 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00884652 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00681535 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106266 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00680838 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00680838 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00729966 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116294 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.007264 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.007264 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0211677 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010721 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0211729 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.010721 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00636641 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104173 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00639722 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00636641 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00714014 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0164109 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00713578 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00713578 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.056515 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00913686 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0562712 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00913686 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00724251 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0133074 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00720686 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00720686 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0286217 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0210808 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0286135 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0210808 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00637655 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00996632 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0063672 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0063672 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00714629 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0131055 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00713143 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00713143 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0562225 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00875294 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0564587 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00875294 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00680903 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107167 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00681578 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00680903 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00722811 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107301 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0072448 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00722811 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0296375 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00994164 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0285821 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00994164 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00636661 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673558 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00635389 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00635389 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0071488 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00987916 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0071456 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0071456 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0566126 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00778562 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0564846 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00778562 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00682014 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00680599 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00682971 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00680599 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0289381 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00810463 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0290149 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00810463 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00635846 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101757 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00637496 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00635846 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00714834 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00674888 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0071456 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00674888 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0558811 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00923629 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0559238 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00923629 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00682863 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00680882 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00682406 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00680882 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00723154 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00683951 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00724891 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00683951 [04/18/2023-13:39:39] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(408000,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3_copy_output (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00328925 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621754 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00328322 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00328322 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(1,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3_copy_output (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00329361 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00662151 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0033094 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00329361 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(1:4,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3_copy_output (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0142363 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.167058 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0141897 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0141897 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Float(408000:32,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3_copy_output (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0243261 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.168082 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0246956 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0243261 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(408000,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3_copy_output (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00329413 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0079779 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00331335 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00329413 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(408000:2,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3_copy_output (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.006196 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0558324 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00619981 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.006196 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(1:4,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3_copy_output (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00620609 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0558796 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00619981 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00619981 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(1:8,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3_copy_output (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0142926 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0573105 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0142338 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0142338 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(1:16,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3_copy_output (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0242187 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0576853 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.024461 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0242187 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3_copy_output (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0242103 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.057856 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0243665 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0242103 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:39] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-13:39:39] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) long-strided -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) long-strided -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) long-strided -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) long-strided -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) long-strided -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) long-strided -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:39] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.71/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00377804 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0226384 [04/18/2023-13:39:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00312079 [04/18/2023-13:39:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00312079 [04/18/2023-13:39:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:39] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:39] [V] [TRT] --------------- Timing Runner: /model.71/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325201 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0129945 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00308756 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00308756 [04/18/2023-13:39:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: /model.71/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0049362 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0126023 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0042041 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0042041 [04/18/2023-13:39:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: /model.71/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00420397 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102289 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00362217 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00362217 [04/18/2023-13:39:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: /model.71/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033516 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0124282 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283285 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00283285 [04/18/2023-13:39:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: /model.71/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00417554 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010019 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00323281 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00323281 [04/18/2023-13:39:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: /model.71/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00392068 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105012 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0038175 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0038175 [04/18/2023-13:39:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: /model.71/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00350985 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121871 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00476206 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00350985 [04/18/2023-13:39:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: /model.71/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00432 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102269 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0031998 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0031998 [04/18/2023-13:39:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:40] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: /model.70/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0032641 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0226482 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00426098 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0032641 [04/18/2023-13:39:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: /model.70/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00346623 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115419 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00297357 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00297357 [04/18/2023-13:39:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: /model.70/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0042642 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106354 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00427267 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0042642 [04/18/2023-13:39:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: /model.70/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00340397 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104313 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00438539 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00340397 [04/18/2023-13:39:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: /model.70/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342748 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117623 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00318273 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00318273 [04/18/2023-13:39:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: /model.70/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00427818 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106625 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00314792 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00314792 [04/18/2023-13:39:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: /model.70/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00380896 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00999954 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00381606 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00380896 [04/18/2023-13:39:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: /model.70/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00671065 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106005 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00330493 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00330493 [04/18/2023-13:39:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: /model.70/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00432807 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110178 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00318334 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00318334 [04/18/2023-13:39:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:40] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00446786 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100523 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00435075 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00435075 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00488762 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103915 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00487147 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00487147 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.006624 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104078 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00664166 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.006624 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Float(1:4,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00577554 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103784 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00584594 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00577554 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270378 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0208967 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00343706 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00270378 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326743 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00728272 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268174 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00268174 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00446457 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599257 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00293112 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00293112 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00448114 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617886 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00447214 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00447214 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00532995 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610762 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00531962 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00531962 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(1:8,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00849317 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00734971 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00476937 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00476937 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(102000:32,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.169691 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0223236 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.169705 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0223236 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Float(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00411846 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00679626 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00411063 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00411063 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00380511 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0061 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00377035 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00377035 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00779838 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621297 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00776253 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00621297 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Float(1:4,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.014176 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00814146 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0140326 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00814146 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00405511 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613448 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409809 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00405511 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00421324 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594962 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00420518 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00420518 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00345644 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0061 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00342128 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00342128 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(6400,1:16,320,16) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034215 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608857 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00343423 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0034215 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00651532 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603562 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00655293 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00603562 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(1:8,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0147479 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00759531 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0148027 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00759531 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(102000:32,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.171301 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0345408 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.171593 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0345408 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Float(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0103922 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0329728 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0109375 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0103922 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Float(102000,1,5100,255) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0108251 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0332114 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0110057 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0108251 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0111574 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0260998 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00810565 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00810565 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Float(1:4,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0139495 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0161793 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0138967 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0138967 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00435394 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130539 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00427308 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00427308 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00415451 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01096 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0041617 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00415451 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00366699 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00845553 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00363097 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00363097 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(6400,1:16,320,16) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00360777 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00719954 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00366336 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00360777 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00658535 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00915543 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00659262 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00658535 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(1:8,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0147136 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00754262 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.014715 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00754262 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(102000:32,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.17291 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0348782 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.172471 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0348782 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00945714 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0322222 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0117535 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00945714 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0102475 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0329728 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00717554 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00717554 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00766917 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0180291 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00579931 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00579931 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Float(1:4,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0136029 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0127985 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0136046 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0127985 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00414002 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0133345 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00413531 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00413531 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0041118 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00922829 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00411951 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0041118 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00362286 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00726469 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00364617 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00362286 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0036144 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00648745 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00363669 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0036144 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00639364 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596267 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00639006 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00596267 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(1:8,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0143794 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00753492 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.014405 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00753492 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(102000:32,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.172178 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0201366 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.177422 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0201366 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00336819 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0441417 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00336117 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00336117 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00451943 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0441543 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004525 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00451943 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00504449 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0441063 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00506309 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00504449 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00686172 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0441691 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00687674 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00686172 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00336181 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0234795 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00337106 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00336181 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034597 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0213407 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345546 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00345546 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00466625 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0214145 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00467421 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00466625 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00466212 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0214407 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00466345 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00466212 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00548995 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0214139 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00551859 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00548995 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(1:8,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00856443 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0233822 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00861392 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00856443 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(102000:32,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.17291 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0213198 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.172485 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0213198 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00228651 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.020898 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00315409 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00228651 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00423556 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592366 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00422817 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00422817 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.004713 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607371 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00473158 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.004713 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00668613 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606571 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00668509 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00606571 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Float(1:4,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00577975 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0221283 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00578706 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00577975 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00314892 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614876 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266235 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00266235 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00432309 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604914 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0029045 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0029045 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00431341 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00642286 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00433385 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00431341 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00535331 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616628 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00525943 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00525943 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Half(1:8,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00847785 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00718309 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00488031 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00488031 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Half(102000:32,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.169984 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0162194 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.169984 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0162194 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00323078 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589659 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00261527 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00261527 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00358777 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588453 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00358766 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00358766 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00422615 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00844006 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00420706 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00420706 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00676468 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595352 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00674078 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00595352 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Float(1:4,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0128983 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0222772 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.012877 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.012877 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00312268 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00642504 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265973 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00265973 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00377444 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607905 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00308572 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00308572 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0037413 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00864619 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00374494 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0037413 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00538599 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610533 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00532233 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00532233 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(1:8,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.013659 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00899829 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0136657 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00899829 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(102000:32,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.170569 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0169818 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.171008 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0169818 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Float(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00425385 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590519 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025871 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0025871 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Float(102000,1,5100,255) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326525 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00714857 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00328582 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00326525 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00392315 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608476 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00391771 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00391771 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00767471 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586405 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00768265 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00586405 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Float(1:4,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0143543 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0223327 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0137376 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0137376 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0041634 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604476 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00256229 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00256229 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00422844 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599733 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243138 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00243138 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(6400,1:16,320,16) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00361303 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612019 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00362229 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00361303 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00642206 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00734651 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00643856 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00642206 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(1:8,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0144718 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00823873 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0144485 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00823873 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(102000:32,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.173463 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0171835 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.171909 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0171835 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Float(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00424228 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589623 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00435602 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00424228 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Float(102000,1,5100,255) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00333087 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602438 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00327813 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00327813 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0039276 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612876 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039491 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0039276 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0076723 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00662172 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00768674 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00662172 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Float(1:4,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0137791 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0222942 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0137093 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0137093 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Half(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00416562 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0061581 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00417345 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00416562 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00421607 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607562 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00422306 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00421607 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00355044 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00358709 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00355044 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0064471 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00640934 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00642862 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00640934 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Half(1:8,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0145545 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00821714 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0144453 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00821714 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Half(102000:32,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.171995 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.017313 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.172032 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.017313 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00409064 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594359 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0040832 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0040832 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00333353 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599029 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00327397 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00327397 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00397829 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605543 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00395441 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00395441 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0072368 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611752 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00713056 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00611752 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(1:4,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0132031 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0222883 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0132588 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0132031 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0040466 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621654 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409051 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0040466 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00410893 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616952 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00410344 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00410344 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00547505 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606857 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0035578 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0035578 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00358503 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611105 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00356761 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00356761 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(1:8,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.01392 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0082273 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0144411 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0082273 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(102000:32,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.171301 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173267 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.172667 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0173267 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033718 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0160198 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00329475 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00329475 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00452071 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0163505 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004532 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00452071 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00505474 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0161443 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00504166 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00504166 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00687325 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0161057 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00685605 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00685605 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Float(1:4,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00593116 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0254324 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00591433 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00591433 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00329984 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.067389 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00329631 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00329631 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00337446 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0653333 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00337467 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00337446 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00463263 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.064707 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00463292 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00463263 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00463454 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0647558 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00464575 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00463454 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00544152 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0647558 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00542171 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00542171 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Half(102000:32,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.172617 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0216718 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.172471 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0216718 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00703608 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0165425 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00703913 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00703608 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00752265 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0167782 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00751928 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00751928 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00767447 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0167797 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00770382 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00767447 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00891106 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0168996 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00890057 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00890057 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Float(1:4,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00942486 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0263558 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00950657 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00942486 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00627816 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0679421 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0062565 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0062565 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00635667 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0665341 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0110523 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00635667 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0104575 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0664625 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0112809 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0104575 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0105881 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0665112 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0116417 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0105881 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0105773 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0664686 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0134479 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0105773 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Half(1:8,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0123406 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0325339 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0129945 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0123406 [04/18/2023-13:39:40] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(25600,1:4,1280,64) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0116747 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0239787 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00840889 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00840889 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Float(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(25600,1:4,1280,64) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00687608 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0176203 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0059781 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0059781 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(6400,1:16,320,16) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Float(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Float(102000,1,5100,255) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(25600,1:4,1280,64) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00469147 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0138028 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00450786 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00450786 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(6400,1:16,320,16) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(25600,1:4,1280,64) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00388114 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111757 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0037671 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0037671 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(25600,1:4,1280,64) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0047183 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0214341 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00467333 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00467333 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Half(25600,1:4,1280,64) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00429499 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00766316 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00429486 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00429486 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(25600,1:4,1280,64) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00375338 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00685301 [04/18/2023-13:39:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00377877 [04/18/2023-13:39:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00375338 [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:4,1280,64) -> Float(102000,400,20,1) *************** [04/18/2023-13:39:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00423731 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614571 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00423664 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00423664 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:4,1280,64) -> Float(102000,1,5100,255) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326068 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609562 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00326265 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00326068 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:4,1280,64) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00391055 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00620476 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00396978 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00391055 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:4,1280,64) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00766797 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603943 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00766316 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00603943 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:4,1280,64) -> Half(102000,400,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0041553 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062394 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00416836 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0041553 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:4,1280,64) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00421674 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00705741 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0042275 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00421674 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:4,1280,64) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00356025 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00632865 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00410697 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00356025 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:4,1280,64) -> Half(6400,1:16,320,16) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00364057 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00642226 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00355891 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00355891 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:4,1280,64) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00640954 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0063837 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00642226 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0063837 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Float(102000,400,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Float(102000,1,5100,255) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(102000,400,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(25600,1:4,1280,64) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00354709 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00643717 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00356493 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00354709 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(6400,1:16,320,16) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Float(102000,400,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Float(102000,1,5100,255) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Half(102000,400,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Half(25600,1:4,1280,64) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00355077 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00962621 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00356092 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00355077 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(25600,1:4,1280,64) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00356237 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631175 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00355657 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00355657 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Half(25600,1:4,1280,64) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00462732 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.064867 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00463646 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00462732 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Half(25600,1:4,1280,64) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00669818 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0664518 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00669444 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00669444 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:39:41] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00313113 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00701453 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00372009 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00313113 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00327148 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677132 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00327719 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00327148 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0163947 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677735 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0165044 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00677735 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248899 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104242 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00341595 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00248899 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00322814 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621734 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266404 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00266404 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00324769 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00873439 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00289061 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00289061 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00339126 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00781065 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00288923 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00288923 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00355457 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615752 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00359074 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00355457 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00864618 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00721641 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00867845 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00721641 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00396701 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0072672 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00397562 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00396701 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00322123 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104522 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00323657 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00322123 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0166573 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00711227 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0166583 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00711227 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00397219 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613143 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00398298 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00397219 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00404889 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102054 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00405968 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00404889 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0032508 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629963 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00325964 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0032508 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00336893 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00988404 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00339349 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00336893 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00356304 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626623 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00354932 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00354932 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00925572 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614133 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00926514 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00614133 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00406527 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00730788 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0040687 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00406527 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326327 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00697927 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00324592 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00324592 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0165399 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00702672 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.016576 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00702672 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00405701 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618838 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00406819 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00405701 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00408594 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00715695 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00408411 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00408411 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034301 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630102 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345567 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0034301 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00359371 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062231 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00360869 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00359371 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00373697 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00623324 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00373744 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00373697 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00927829 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616552 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00926943 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00616552 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00405409 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00728777 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00406895 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00405409 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.003272 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00695902 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00323251 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00323251 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344403 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00694444 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00343815 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00343815 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00407238 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611905 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00402705 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00402705 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00411559 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611943 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0041408 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00411559 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344446 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006144 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00344653 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00344446 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00359851 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606076 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00359634 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00359634 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00374213 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006136 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00372243 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00372243 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0095293 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00620286 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00951714 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00620286 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00225557 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00635587 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00315061 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00225557 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00314315 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613752 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00317795 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00314315 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325745 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00625928 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00327844 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00325745 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0162616 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00640616 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0162596 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00640616 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00313441 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00627498 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266904 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00266904 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00320335 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0064316 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0029523 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0029523 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00332502 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00624835 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00297133 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00297133 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0035394 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626166 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00352413 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00352413 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00862629 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062873 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00862198 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0062873 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00322946 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602324 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265498 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00265498 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00328717 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612648 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00328239 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00328239 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00348477 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622589 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.003487 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00348477 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0164363 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00628174 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0164165 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00628174 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00313113 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00713121 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00261137 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00261137 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00341986 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00624278 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00342204 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00341986 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00352056 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615905 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247882 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00247882 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00368903 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621356 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00367496 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00367496 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00704805 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622927 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00708093 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00622927 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00406743 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603676 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00406959 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00406743 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00327958 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00620762 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00326878 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00326878 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00347853 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631672 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0034794 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00347853 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0167055 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00620647 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0167233 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00620647 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00408178 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114187 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00399301 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00399301 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00400406 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109061 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00404521 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00400406 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0036827 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010864 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00380487 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0036827 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00379224 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108607 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00366968 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00366968 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00915372 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105136 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00913829 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00913829 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00408882 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00657205 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254156 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00254156 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0032614 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00627955 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00328582 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0032614 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00348125 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00627637 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349168 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00348125 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0166603 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630122 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0167131 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00630122 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00404317 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00737668 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244331 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00244331 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00403822 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00620114 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002368 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.002368 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034068 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00650244 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00337807 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00337807 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00367367 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00640497 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00370473 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00367367 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00920772 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104199 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00920429 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00920429 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00406032 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108036 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00407162 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00406032 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00346601 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103432 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00501297 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00346601 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00359943 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107837 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.003663 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00359943 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0166705 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105107 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0166486 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0105107 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00403962 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113287 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00494818 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00403962 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00401613 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011091 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00404749 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00401613 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00352145 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108797 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00365417 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00352145 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0039402 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108255 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00441185 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0039402 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00925629 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105443 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00934886 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00925629 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00404597 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105858 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0040466 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00404597 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0036902 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105858 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00351967 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00351967 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00354431 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107624 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00393995 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00354431 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0166928 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00952472 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0165765 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00952472 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00426017 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106769 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00399873 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00399873 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00343673 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00993463 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00351242 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00343673 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00355022 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107824 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00366418 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00355022 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00415733 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112169 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00419918 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00415733 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00423677 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110927 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00489707 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00423677 [04/18/2023-13:39:41] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00352089 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108823 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00369477 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00352089 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00415791 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110903 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00382881 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00382881 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00478674 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112418 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0029088 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0029088 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00399187 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00986728 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00429741 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00399187 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00401333 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102328 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00403797 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00401333 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00406857 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101477 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00404686 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00404686 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344555 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105515 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00336776 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00336776 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00407898 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00985874 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00407149 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00407149 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00408633 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00653297 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00412095 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00408633 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00408202 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102096 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409313 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00408202 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00359794 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103357 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00361451 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00359794 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00408281 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102589 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00406476 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00406476 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00406006 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103027 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00405448 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00405448 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0041297 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102707 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00416771 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0041297 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00358697 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102001 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0036504 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00358697 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00286784 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00729783 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00315081 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00286784 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033701 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010463 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00288256 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00288256 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00332726 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00734583 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00302009 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00302009 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325631 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101702 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00278857 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00278857 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326151 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104317 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00287415 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00287415 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00352201 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101346 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026363 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0026363 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00404419 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102609 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00415256 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00404419 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00397447 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00708376 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00399263 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00397447 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00407225 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104696 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00400432 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00400432 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00357234 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107762 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00351911 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00351911 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00410723 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00990598 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283626 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00283626 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00402933 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100766 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00279385 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00279385 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00410318 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00625292 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235796 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235796 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00406933 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594286 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0040334 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0040334 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00397615 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00754478 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00405701 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00397615 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00401346 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00635588 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00402057 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00401346 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00348934 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611124 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00353706 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00348934 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00403289 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595328 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00404317 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00403289 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0040132 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105891 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409313 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0040132 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00333406 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599848 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00332885 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00332885 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00354353 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605657 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347037 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00347037 [04/18/2023-13:39:41] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) long-strided -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00312765 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00707701 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00310663 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00310663 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) long-strided -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00315796 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0070831 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00318375 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00315796 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) long-strided -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0156777 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00688871 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.015659 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00688871 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) long-strided -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00304924 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00640775 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00306801 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00304924 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) long-strided -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00313689 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00925314 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00314276 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00313689 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) long-strided -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0031517 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617581 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00318009 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0031517 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) long-strided -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00327834 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606667 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00327938 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00327834 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) long-strided -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00351654 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611105 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00351008 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00351008 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) long-strided -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00840336 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608324 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00839924 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00608324 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) long-strided -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00304924 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631771 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00306655 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00304924 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) long-strided -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00308406 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604762 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00309009 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00308406 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) long-strided -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00319685 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614571 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00320721 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00319685 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) long-strided -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0155319 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00625173 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0155593 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00625173 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) long-strided -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00307142 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613467 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00306519 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00306519 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) long-strided -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00314981 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619657 [04/18/2023-13:39:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00314782 [04/18/2023-13:39:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00314782 [04/18/2023-13:39:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) long-strided -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00323312 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612514 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00325164 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00323312 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) long-strided -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00346591 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614438 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345535 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00345535 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) long-strided -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00834768 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619905 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00835784 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00619905 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) long-strided -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00366957 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107729 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00378202 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00366957 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) long-strided -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00368762 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106596 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00380608 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00368762 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) long-strided -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0037004 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010641 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00440353 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0037004 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) long-strided -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0158752 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108441 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0160945 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0108441 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) long-strided -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00440118 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116265 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00397409 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00397409 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) long-strided -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00392439 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109349 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00436197 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00392439 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) long-strided -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00378875 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105042 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00395268 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00378875 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) long-strided -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00410344 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105577 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00394057 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00394057 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) long-strided -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0071696 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106779 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00711989 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00711989 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) long-strided -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00407378 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105326 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00406984 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00406984 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) long-strided -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00364594 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107249 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00380174 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00364594 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) long-strided -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00373216 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107311 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409701 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00373216 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) long-strided -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0157742 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010496 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0157358 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.010496 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) long-strided -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00400673 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112186 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00401092 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00400673 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) long-strided -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0040739 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105113 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00420491 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0040739 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) long-strided -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00374482 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010847 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00389399 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00374482 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) long-strided -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00382292 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107269 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039402 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00382292 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) long-strided -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00901486 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105669 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00888336 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00888336 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(97200,32400,1620,81,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00375478 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110112 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039654 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00375478 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(97200,32400,1620,81,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00371739 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106704 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039533 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00371739 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(97200,32400,1620,81,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00372173 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010786 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00391178 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00372173 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(97200,32400,1620,81,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0156795 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108219 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0157111 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0108219 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(97200,32400,1620,81,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00379248 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010929 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039528 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00379248 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(97200,32400,1620,81,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00393687 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105463 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00388856 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00388856 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(97200,32400,1620,81,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0037263 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105757 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00412356 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0037263 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(97200,32400,1620,81,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00367496 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010511 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00398374 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00367496 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(97200,32400,1620,81,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00376493 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105639 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00392105 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00376493 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(97200,32400,1620,81,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00841224 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105035 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00841143 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00841143 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(97200,32400,1620,81,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038003 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109639 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00399467 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0038003 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(97200,32400,1620,81,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00381546 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105048 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00408829 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00381546 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(97200,32400,1620,81,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00386607 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107233 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00398895 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00386607 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(97200,32400,1620,81,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0155634 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102184 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0155209 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0102184 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(97200,32400,1620,81,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00426689 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109922 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00412617 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00412617 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(97200,32400,1620,81,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00388398 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110759 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00396886 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00388398 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(97200,32400,1620,81,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00389387 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108346 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00398298 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00389387 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(97200,32400,1620,81,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00388497 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107089 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00406705 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00388497 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(97200,32400,1620,81,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038783 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107504 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00424645 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0038783 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(97200,32400,1620,81,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00838527 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107331 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00835251 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00835251 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1620:2,81,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00360069 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105091 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0037215 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00360069 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1620:2,81,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00360869 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104744 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00374224 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00360869 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1620:2,81,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00377179 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105287 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00393526 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00377179 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1620:2,81,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0158969 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104245 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0159568 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0104245 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1620:2,81,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00365623 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010911 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00389646 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00365623 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1620:2,81,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00360971 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105316 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00393859 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00360971 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1620:2,81,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00378303 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112306 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00392228 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00378303 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1620:2,81,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00369958 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105802 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00395058 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00369958 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1620:2,81,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00384397 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105858 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00391524 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00384397 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1620:2,81,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0071421 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010528 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00714651 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0071421 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(14580,4860,1:8,243,3) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00405917 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01061 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00435505 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00405917 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(14580,4860,1:8,243,3) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00365257 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106465 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00380355 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00365257 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(14580,4860,1:8,243,3) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00371774 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111328 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00388102 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00371774 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(14580,4860,1:8,243,3) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0157742 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105107 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0157723 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0105107 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(14580,4860,1:8,243,3) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00406133 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108108 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00396726 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00396726 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(14580,4860,1:8,243,3) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00403974 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105381 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00405638 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00403974 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(14580,4860,1:8,243,3) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00371235 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108353 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00396516 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00371235 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(14580,4860,1:8,243,3) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00368399 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108385 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00394465 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00368399 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(14580,4860,1:8,243,3) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00382424 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107438 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00393229 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00382424 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(14580,4860,1:8,243,3) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00889977 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105956 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00888901 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00888901 [04/18/2023-13:39:42] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00392945 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107203 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00412931 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00392945 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00397892 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107814 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00410893 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00397892 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00405714 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108862 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00420881 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00405714 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00399517 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104281 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00415726 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00399517 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00336904 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105133 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00352892 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00336904 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00391005 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010561 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00339997 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00339997 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.003984 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106132 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00331345 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00331345 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00400203 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105956 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00414615 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00400203 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00397257 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105698 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00415935 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00397257 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00399174 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104516 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334862 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00334862 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00390709 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105593 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409939 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00390709 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00392649 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106968 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409378 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00392649 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(600,200,1:4,10,5) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00403505 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110093 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00453143 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00403505 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00384686 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114469 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00622523 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00384686 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249372 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00696555 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248607 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248607 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237962 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00737669 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240335 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237962 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236275 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613257 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235474 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235474 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235444 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607619 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233253 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00233253 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(240,80,1:16,4,2) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234522 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609562 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234867 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234522 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247046 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598857 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246495 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246495 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249482 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677278 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249143 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249143 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344479 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00671938 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345763 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00344479 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023707 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609524 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237025 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237025 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(2400,800,1,40,20) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234013 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621893 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232059 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00232059 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269542 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619276 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270508 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00269542 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251012 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673455 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252343 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00251012 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238103 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006076 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236418 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236418 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238804 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601848 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239177 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238804 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236853 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611657 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236388 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236388 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(240,80,1:16,4,2) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243394 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609581 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236875 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236875 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251188 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600381 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248867 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248867 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252086 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00672416 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253803 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00252086 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344207 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0067813 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00343238 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00343238 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239177 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608476 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239672 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239177 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235668 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617333 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235578 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235578 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235953 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621105 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234769 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234769 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253546 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675865 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254757 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00253546 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241333 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608438 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242348 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00241333 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242658 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598552 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243773 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00242658 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241364 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595127 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00297848 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00241364 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00410593 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106762 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00428343 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00410593 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00397968 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106364 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00410723 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00397968 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00398527 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119749 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00413218 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00398527 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00382051 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120686 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00380126 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00380126 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00400076 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106664 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00418638 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00400076 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00351855 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00696512 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246983 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246983 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00255176 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00683516 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248694 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248694 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00276299 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0068554 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00277433 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00276299 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237055 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605962 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235226 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235226 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00245695 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00684038 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245765 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00245695 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249947 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677319 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025102 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00249947 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251581 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00679564 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253634 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00251581 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254797 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676655 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255502 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00254797 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239299 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608914 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239802 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239299 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344033 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593518 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00342694 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00342694 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0019225 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616286 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00211375 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0019225 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234394 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590921 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234153 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234153 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235369 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604305 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235773 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235369 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268766 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601562 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270491 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00268766 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237407 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590629 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235863 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235863 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00230798 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612248 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00201433 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00201433 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234507 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615791 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236867 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234507 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0026496 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607219 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002329 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.002329 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241051 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612876 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243487 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00241051 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234971 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591799 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00222115 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00222115 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342922 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00781714 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00378791 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00342922 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00300114 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102201 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00280991 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00280991 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00306704 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103664 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.003333 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00306704 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00308455 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104105 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00320091 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00308455 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00299143 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110132 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00313351 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00299143 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00289307 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00672145 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245679 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00245679 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00230776 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062019 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00196308 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00196308 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00245191 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0061099 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00224814 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00224814 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236111 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610476 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234739 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234739 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249127 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0061339 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249505 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00249127 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00263896 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114824 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00316144 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00263896 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00345894 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00816305 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345121 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00345121 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242194 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605962 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0021848 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0021848 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(2400,800,1,40,20) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237497 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611676 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234312 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234312 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(600,200,1:4,10,5) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237677 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614133 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023692 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0023692 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271232 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605867 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270327 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00270327 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252656 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00680229 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025288 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00252656 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234334 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006116 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00218057 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00218057 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235294 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617524 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00211072 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00211072 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(240,80,1:16,4,2) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235841 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621277 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235144 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235144 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00244618 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618514 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245703 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00244618 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025126 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0068837 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250294 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250294 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344327 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00679668 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345633 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00344327 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00350249 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00900457 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00308756 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00308756 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(2400,800,1,40,20) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270974 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612952 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243804 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00243804 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(600,200,1:4,10,5) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237212 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613505 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237025 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237025 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00279648 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600591 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272871 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00272871 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253193 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00669319 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253113 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00253113 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234297 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608514 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235001 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234297 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00244974 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604667 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236178 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236178 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233519 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615029 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023429 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00233519 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00245997 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607162 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247819 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00245997 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252319 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675948 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252872 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00252319 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00349525 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00674223 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345959 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00345959 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237504 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.005988 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237092 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237092 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249435 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00703265 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00368377 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00249435 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243735 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00696098 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245889 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00243735 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269706 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611105 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00287708 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00269706 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00264931 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00668613 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253466 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00253466 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235301 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616876 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235826 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235301 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237819 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00807822 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239352 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237819 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234462 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615581 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236058 [04/18/2023-13:39:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234462 [04/18/2023-13:39:42] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-13:39:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234582 [04/18/2023-13:39:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616438 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244587 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234582 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00256196 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00685548 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251445 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251445 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034461 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00668779 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00360697 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0034461 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00984828 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0138045 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.014898 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00984828 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00388979 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119695 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00407708 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00388979 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0039061 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120446 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409966 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0039061 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00537481 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0140264 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0279647 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00537481 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00391228 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107713 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00416875 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00391228 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00388386 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108003 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347461 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00347461 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00404394 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0150021 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00374505 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00374505 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00405232 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120133 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00412983 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00405232 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00404787 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120907 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00465696 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00404787 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00447973 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0457874 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00402209 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00402209 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00385083 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106547 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00397067 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00385083 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00372337 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104839 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0072832 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00372337 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00435671 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.09728 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334629 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00334629 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250723 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00705589 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254212 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00250723 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00276088 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00961067 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00275086 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00275086 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240739 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621138 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239558 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239558 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237609 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00869646 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242611 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237609 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248505 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00693834 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024692 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0024692 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250168 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00693464 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249978 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249978 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253915 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00715314 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251348 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251348 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253506 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00699581 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254685 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00253506 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238415 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608971 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237699 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237699 [04/18/2023-13:39:43] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,40,2,1) -> Float(800,800,1,40,20) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235676 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607657 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238179 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235676 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,40,2,1) -> Float(200,200,1:4,10,5) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238134 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606762 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237789 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237789 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,40,2,1) -> Float(40,40,40:32,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270266 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604972 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272569 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00270266 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240541 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601029 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232796 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00232796 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,40,2,1) -> Half(800,800,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00191726 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00624358 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235563 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00191726 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,40,2,1) -> Half(400,400,40:2,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235166 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00757348 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002183 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.002183 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,40,2,1) -> Half(120,120,1:8,6,3) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237077 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606933 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237542 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237077 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,40,2,1) -> Half(80,80,1:16,4,2) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239337 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609371 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238142 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238142 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,40,2,1) -> Half(40,40,40:32,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242042 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612781 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241752 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00241752 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236905 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606248 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00222797 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00222797 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00359531 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00620762 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00361452 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00359531 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1,40,20) -> Float(800,800,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235976 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605143 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238811 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235976 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1,40,20) -> Float(200,200,1:4,10,5) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248363 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619695 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236523 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236523 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1,40,20) -> Float(40,40,40:32,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267369 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616895 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026775 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00267369 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1,40,20) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242487 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0068628 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024358 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00242487 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1,40,20) -> Half(800,800,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023635 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613962 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235698 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235698 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1,40,20) -> Half(400,400,40:2,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238872 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608248 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237902 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237902 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1,40,20) -> Half(120,120,1:8,6,3) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235459 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612152 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235781 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235459 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1,40,20) -> Half(80,80,1:16,4,2) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238492 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631215 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002776 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238492 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1,40,20) -> Half(40,40,40:32,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252279 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607714 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245563 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00245563 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1,40,20) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246904 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00682514 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247984 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00246904 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1,40,20) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0036368 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0073168 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0036544 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0036368 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(200,200,1:4,10,5) -> Float(800,800,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242402 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614933 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023689 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0023689 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(200,200,1:4,10,5) -> Float(800,800,1,40,20) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235361 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00623463 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237017 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235361 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(200,200,1:4,10,5) -> Float(40,40,40:32,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0027018 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616114 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271293 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0027018 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(200,200,1:4,10,5) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024718 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00684103 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249017 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0024718 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(200,200,1:4,10,5) -> Half(800,800,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239124 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611543 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246952 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239124 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(200,200,1:4,10,5) -> Half(400,400,40:2,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250223 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616419 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238865 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238865 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(200,200,1:4,10,5) -> Half(120,120,1:8,6,3) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243944 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00700778 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241151 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00241151 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(200,200,1:4,10,5) -> Half(80,80,1:16,4,2) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251854 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103713 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243704 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00243704 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(200,200,1:4,10,5) -> Half(40,40,40:32,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249474 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0061341 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00333943 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00249474 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(200,200,1:4,10,5) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00260173 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00716297 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025191 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0025191 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(200,200,1:4,10,5) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00365097 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00672894 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00366023 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00365097 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(40,40,40:32,2,1) -> Float(800,800,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025114 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00843778 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00257086 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0025114 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(40,40,40:32,2,1) -> Float(800,800,1,40,20) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234537 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00992884 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234627 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234537 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(40,40,40:32,2,1) -> Float(200,200,1:4,10,5) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253281 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00682852 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00322133 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00253281 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(40,40,40:32,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0026604 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113551 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00320285 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0026604 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(40,40,40:32,2,1) -> Half(800,800,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00244486 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622569 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245703 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00244486 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(40,40,40:32,2,1) -> Half(400,400,40:2,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00306013 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00637078 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00260347 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00260347 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(40,40,40:32,2,1) -> Half(120,120,1:8,6,3) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240968 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00773943 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237887 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237887 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(40,40,40:32,2,1) -> Half(80,80,1:16,4,2) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241417 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608629 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00260214 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00241417 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(40,40,40:32,2,1) -> Half(40,40,40:32,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00256906 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00746688 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250851 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250851 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(40,40,40:32,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254436 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675117 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253233 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00253233 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(40,40,40:32,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038335 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0070117 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00371774 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00371774 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(800,800,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00293435 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626922 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244719 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00244719 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(800,800,1,40,20) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252046 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00902286 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252255 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00252046 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(200,200,1:4,10,5) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00263614 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00683037 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265981 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00263614 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(40,40,40:32,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00276325 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00682166 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00350194 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00276325 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(800,800,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241608 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00801473 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023674 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0023674 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(400,400,40:2,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00278866 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00699821 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245331 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00245331 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(120,120,1:8,6,3) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00284146 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00697622 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255265 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00255265 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(80,80,1:16,4,2) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253883 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00730674 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254821 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00253883 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(40,40,40:32,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253321 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00829791 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00264804 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00253321 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239947 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613067 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00326722 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239947 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00360663 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606876 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00377263 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00360663 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800,40,2,1) -> Float(800,800,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00202566 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00655626 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00210107 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00202566 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800,40,2,1) -> Float(800,800,1,40,20) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00493593 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619772 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234447 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234447 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800,40,2,1) -> Float(200,200,1:4,10,5) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237789 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00683886 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237774 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237774 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800,40,2,1) -> Float(40,40,40:32,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00276774 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606381 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0055149 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00276774 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234994 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616686 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233969 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00233969 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800,40,2,1) -> Half(400,400,40:2,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00255518 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00633004 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00219089 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00219089 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800,40,2,1) -> Half(120,120,1:8,6,3) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024375 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.008568 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235593 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235593 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800,40,2,1) -> Half(80,80,1:16,4,2) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235526 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616667 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00313988 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235526 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800,40,2,1) -> Half(40,40,40:32,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250554 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615276 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00284737 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00250554 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234859 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00647155 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00228673 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00228673 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00367238 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00660239 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00378245 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00367238 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(400,400,40:2,2,1) -> Float(800,800,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00393859 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00819175 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00197241 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00197241 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(400,400,40:2,2,1) -> Float(800,800,1,40,20) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00244796 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598933 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252535 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00244796 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(400,400,40:2,2,1) -> Float(200,200,1:4,10,5) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0026299 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00743314 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00257069 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00257069 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(400,400,40:2,2,1) -> Float(40,40,40:32,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00354565 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605962 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269139 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00269139 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(400,400,40:2,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325392 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00715086 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252207 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252207 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(400,400,40:2,2,1) -> Half(800,800,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00277602 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00926057 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00202926 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00202926 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(400,400,40:2,2,1) -> Half(120,120,1:8,6,3) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234589 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00635965 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00231425 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00231425 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(400,400,40:2,2,1) -> Half(80,80,1:16,4,2) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251429 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00779934 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272362 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00251429 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(400,400,40:2,2,1) -> Half(40,40,40:32,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00296453 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00642584 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254532 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00254532 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(400,400,40:2,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00256857 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00819225 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243169 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00243169 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(400,400,40:2,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00452006 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00806883 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0036807 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0036807 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(120,120,1:8,6,3) -> Float(800,800,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237977 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00817498 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00223414 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00223414 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(120,120,1:8,6,3) -> Float(800,800,1,40,20) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237684 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00709295 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00368645 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237684 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(120,120,1:8,6,3) -> Float(200,200,1:4,10,5) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235571 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619238 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248568 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235571 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(120,120,1:8,6,3) -> Float(40,40,40:32,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00353572 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00645545 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271897 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00271897 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(120,120,1:8,6,3) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00579288 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00679439 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00296079 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00296079 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(120,120,1:8,6,3) -> Half(800,800,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237729 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00651906 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00229805 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00229805 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(120,120,1:8,6,3) -> Half(400,400,40:2,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236493 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676987 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00278022 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236493 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(120,120,1:8,6,3) -> Half(80,80,1:16,4,2) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237669 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619809 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002564 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237669 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(120,120,1:8,6,3) -> Half(40,40,40:32,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00275903 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629506 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251613 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251613 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(120,120,1:8,6,3) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00462924 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00687086 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246652 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246652 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(120,120,1:8,6,3) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00377768 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00709268 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00376999 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00376999 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(80,80,1:16,4,2) -> Float(800,800,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239581 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011308 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248142 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239581 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(80,80,1:16,4,2) -> Float(800,800,1,40,20) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236186 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00656187 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00301648 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236186 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(80,80,1:16,4,2) -> Float(200,200,1:4,10,5) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00255615 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00652945 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269714 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00255615 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(80,80,1:16,4,2) -> Float(40,40,40:32,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0035345 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060541 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00287149 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00287149 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(80,80,1:16,4,2) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00337903 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00755753 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250859 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250859 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(80,80,1:16,4,2) -> Half(800,800,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238293 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111611 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236028 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236028 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(80,80,1:16,4,2) -> Half(400,400,40:2,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00245075 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006072 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237055 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237055 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(80,80,1:16,4,2) -> Half(120,120,1:8,6,3) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236328 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00777121 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024109 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236328 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(80,80,1:16,4,2) -> Half(40,40,40:32,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00245865 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613429 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252503 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00245865 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(80,80,1:16,4,2) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024748 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00688457 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247961 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0024748 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(80,80,1:16,4,2) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00373497 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00684648 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00365086 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00365086 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(40,40,40:32,2,1) -> Float(800,800,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237744 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603238 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238994 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237744 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(40,40,40:32,2,1) -> Float(800,800,1,40,20) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236718 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606876 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237684 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236718 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(40,40,40:32,2,1) -> Float(200,200,1:4,10,5) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239017 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612267 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248867 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239017 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(40,40,40:32,2,1) -> Float(40,40,40:32,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269393 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603162 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283276 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00269393 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(40,40,40:32,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247283 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00669527 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249624 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00247283 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(40,40,40:32,2,1) -> Half(800,800,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246392 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629128 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236972 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236972 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(40,40,40:32,2,1) -> Half(400,400,40:2,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240922 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607829 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238133 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238133 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(40,40,40:32,2,1) -> Half(120,120,1:8,6,3) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234926 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612133 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238286 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234926 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(40,40,40:32,2,1) -> Half(80,80,1:16,4,2) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235661 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609048 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241813 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235661 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(40,40,40:32,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0026637 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00685431 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247078 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00247078 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(40,40,40:32,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00377119 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00672914 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00373884 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00373884 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(800,800,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239292 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605867 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00203577 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00203577 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(800,800,1,40,20) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251004 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00670442 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00260896 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00251004 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(200,200,1:4,10,5) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00256253 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00671148 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00264559 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00256253 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(40,40,40:32,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0027542 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00664499 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272069 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00272069 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252896 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612057 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238171 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238171 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(800,800,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234971 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00689241 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00211079 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00211079 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(400,400,40:2,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241067 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00721263 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242851 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00241067 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(120,120,1:8,6,3) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249111 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00671626 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266362 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00249111 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(80,80,1:16,4,2) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00260073 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0067734 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00262906 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00260073 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(40,40,40:32,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251461 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673288 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252944 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00251461 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00373392 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613562 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00360331 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00360331 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(800,800,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00256193 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611162 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245416 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00245416 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(800,800,1,40,20) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251741 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00745257 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252519 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00251741 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(200,200,1:4,10,5) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254444 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00674244 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255102 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00254444 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(40,40,40:32,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00272819 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00669174 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00275103 [04/18/2023-13:39:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00272819 [04/18/2023-13:39:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00244634 [04/18/2023-13:39:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612171 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024592 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00244634 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(800,800,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241242 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00632546 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238743 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238743 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(400,400,40:2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250803 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00681426 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249379 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249379 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(120,120,1:8,6,3) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251204 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00695619 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025114 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0025114 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(80,80,1:16,4,2) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251557 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0068123 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250404 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250404 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(40,40,40:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251597 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00672707 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00256049 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00251597 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242758 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598114 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253305 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00242758 [04/18/2023-13:39:44] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(600,200,1:4,10,5) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(240,80,1:16,4,2) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(2400,800,1,40,20) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(240,80,1:16,4,2) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(2400,800,1,40,20) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(600,200,1:4,10,5) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(240,80,1:16,4,2) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(2400,800,1,40,20) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(600,200,1:4,10,5) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-13:39:44] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236403 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00646758 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023671 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236403 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236028 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602591 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235091 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235091 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238278 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605771 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238941 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238278 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0028246 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604895 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00281869 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00281869 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238431 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062712 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236897 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236897 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241082 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598648 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238575 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238575 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024096 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00758881 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237355 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237355 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236568 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604114 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238972 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236568 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238705 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595886 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237519 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237519 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250827 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605372 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249687 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249687 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238286 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598629 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238362 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238286 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00230349 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00632884 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00230349 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234852 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00815492 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00310429 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234852 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0028324 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00733257 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00286875 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0028324 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240099 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604286 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239909 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239909 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024399 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00627757 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024064 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0024064 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235571 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631096 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235084 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235084 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235084 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00633063 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237534 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235084 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237145 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00620248 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239368 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237145 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251429 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601905 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250333 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250333 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241455 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592823 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240579 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240579 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234252 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609962 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234245 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234245 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236126 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00620438 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238301 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236126 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00284531 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614362 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00284468 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00284468 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240853 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600629 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243843 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00240853 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246369 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598724 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247188 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00246369 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236845 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630261 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237347 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236845 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238164 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062233 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238834 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238164 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023638 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626504 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240434 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0023638 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254404 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601638 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254003 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00254003 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00258474 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598191 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243518 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00243518 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241714 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606476 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234642 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234642 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024265 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602533 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236882 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236882 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00279974 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629088 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0028074 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00279974 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246629 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597391 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025203 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00246629 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247322 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593646 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248639 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00247322 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024399 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596362 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237602 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237602 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237475 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598991 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237175 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237175 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023952 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058752 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023728 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0023728 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00255184 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589477 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252936 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252936 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023933 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592859 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239322 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239322 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00245765 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00692463 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024934 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00245765 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253265 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00680316 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00256049 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00253265 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00282461 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00671688 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00282837 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00282461 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023981 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595829 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241013 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0023981 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00258663 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0066373 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253017 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00253017 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251172 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00667844 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251316 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00251172 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253714 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00664873 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252912 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252912 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254204 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00658306 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252167 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252167 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00261029 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00663148 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266701 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00261029 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237677 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062712 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023888 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237677 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241768 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589111 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002371 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.002371 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236006 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610895 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235039 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235039 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00282174 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062247 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00276281 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00276281 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239886 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00632984 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241509 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239886 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237797 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615505 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238103 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237797 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236815 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604038 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232147 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00232147 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00232782 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059541 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239154 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00232782 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239947 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611905 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234762 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234762 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249947 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600362 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247243 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00247243 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239512 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586862 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023952 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239512 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236748 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590903 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236073 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236073 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237834 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059821 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238347 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237834 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0027578 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594085 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0027615 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0027578 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237557 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596191 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236208 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236208 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023671 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593774 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235931 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235931 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235174 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603905 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235444 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235174 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234634 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598476 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235459 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234634 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235526 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619257 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00257404 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235526 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254412 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610629 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025618 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00254412 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024282 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592439 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241524 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00241524 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241067 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616038 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234912 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234912 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023821 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610533 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237265 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237265 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0028082 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590994 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00279358 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00279358 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238781 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597391 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023731 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0023731 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240213 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595383 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241897 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00240213 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234649 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619428 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233969 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00233969 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234544 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611086 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023363 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0023363 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234146 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612229 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234492 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234146 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250443 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601048 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025057 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00250443 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240076 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595752 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240389 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00240076 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236058 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606495 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235039 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235039 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237115 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611752 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237032 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237032 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00280811 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596914 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283491 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00280811 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237767 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596419 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237917 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237767 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241074 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00650534 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240823 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240823 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233379 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619009 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235811 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00233379 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233276 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006128 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235016 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00233276 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235009 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617905 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233998 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00233998 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250239 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596514 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249332 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249332 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241554 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587831 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240274 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240274 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235436 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587008 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235721 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235436 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236897 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591653 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238261 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236897 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00279341 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590281 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00280308 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00279341 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240076 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598838 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241646 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00240076 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242417 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006064 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242774 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00242417 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236733 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060301 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243766 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236733 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00284271 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594322 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241082 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00241082 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236965 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00634574 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00294596 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236965 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00336085 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101705 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00375818 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00336085 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00328956 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105819 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00262292 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00262292 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249821 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00666369 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246936 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246936 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025211 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676779 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251477 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251477 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00278576 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00665351 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00280883 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00278576 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237549 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677818 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238446 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237549 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250939 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00668634 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249214 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249214 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00300514 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114286 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00315727 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00300514 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00301448 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113596 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245129 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00245129 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00369594 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117764 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0036344 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0036344 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00341475 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117904 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346057 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00341475 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325829 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00944686 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00338296 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00325829 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00343619 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117102 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00352814 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00343619 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00348733 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118372 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00362651 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00348733 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00349926 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117662 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00353751 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00349926 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00340506 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103768 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00351019 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00340506 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00337201 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118463 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00352636 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00337201 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00345404 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120198 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00325236 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00325236 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00306509 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113333 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00317187 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00306509 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00275745 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673746 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251397 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251397 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025707 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00674556 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00256727 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00256727 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236223 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622489 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236995 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236223 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236126 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605219 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234469 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234469 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236583 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604133 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023701 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236583 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00281708 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605752 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00282102 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00281708 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237624 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006132 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236853 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236853 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240678 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592585 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240122 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240122 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250779 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00996876 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00314246 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00250779 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00300857 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00992091 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00314027 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00300857 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00302676 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00996876 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00309826 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00302676 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00301095 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101199 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00312556 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00301095 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00296592 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00982705 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00306198 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00296592 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0029999 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102423 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00308931 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0029999 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00312209 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00686846 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246849 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246849 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00284307 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605086 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00280139 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00280139 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242286 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592457 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023997 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0023997 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243371 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588635 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240899 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240899 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233615 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610324 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242487 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00233615 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235361 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601105 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243781 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235361 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235316 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602971 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002368 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235316 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253474 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.005856 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251565 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251565 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241791 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00581321 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241143 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00241143 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233829 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607448 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234612 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00233829 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235766 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608686 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237287 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235766 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0028143 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602819 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00281914 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0028143 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240571 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590044 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241303 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00240571 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00244417 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059061 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245943 [04/18/2023-13:39:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00244417 [04/18/2023-13:39:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:44] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236613 [04/18/2023-13:39:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601029 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236088 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236088 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237579 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603657 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237032 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237032 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238103 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608172 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238781 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238103 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254236 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585326 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00275306 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00254236 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00245191 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582857 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244595 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00244595 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235346 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602514 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236178 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235346 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023665 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603238 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237175 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0023665 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00275525 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604571 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00276097 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00275525 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246424 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599048 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245865 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00245865 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249561 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595543 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248843 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248843 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235549 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598419 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236365 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235549 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236875 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588014 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240267 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236875 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238194 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00719566 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239634 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238194 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00256163 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253907 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00253907 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238949 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593682 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248544 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238949 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00262708 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006816 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248039 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248039 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251501 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00705437 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250451 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250451 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00282425 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00680555 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00282496 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00282425 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241295 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598895 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240465 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240465 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251132 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00672582 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252407 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00251132 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251509 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00671003 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249978 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249978 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249766 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00674888 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250715 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00249766 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252985 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00797232 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252263 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252263 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00260571 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00679647 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00260596 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00260571 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238324 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00780223 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239566 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238324 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236148 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00721394 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234087 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234087 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023704 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0087161 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00318141 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0023704 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00289737 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606476 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00288996 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00288996 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235504 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00645724 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235916 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235504 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238362 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629963 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240815 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238362 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233917 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614133 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232929 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00232929 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00232435 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602076 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232988 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00232435 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233637 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605448 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232841 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00232841 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024666 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599486 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247086 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0024666 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240472 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594322 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240183 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240183 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237017 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00572562 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237834 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237017 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236823 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598705 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238133 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236823 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00290542 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0129114 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00290057 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00290057 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238164 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606495 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236673 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236673 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236987 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592914 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235908 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235908 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235758 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00735794 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234529 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234529 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235166 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592585 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236216 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235166 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235841 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00727576 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002362 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235841 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00256074 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600095 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254605 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00254605 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240686 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591324 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240412 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240412 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234417 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609314 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234867 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234417 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237182 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612172 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236755 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236755 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00282335 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595771 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283984 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00282335 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023743 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589861 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239261 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0023743 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241082 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586478 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240221 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240221 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.002329 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621396 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233224 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.002329 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233637 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606724 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234267 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00233637 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235046 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615105 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233947 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00233947 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249584 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597238 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249119 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249119 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024141 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590647 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241173 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00241173 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235504 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610019 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235676 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235504 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237145 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610762 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238339 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237145 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00285006 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593573 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00284011 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00284011 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239817 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599181 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239634 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239634 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243773 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601524 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242844 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00242844 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234138 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00650494 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234522 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234138 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234207 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617695 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235736 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234207 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234709 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00623483 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236066 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234709 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250412 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602019 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249458 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249458 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241752 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059445 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240206 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240206 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235668 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593847 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234829 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234829 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237887 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609562 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236545 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236545 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00281259 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597505 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0028134 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00281259 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023936 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622808 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245749 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0023936 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243526 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602095 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247283 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00243526 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233924 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606286 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234679 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00233924 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234904 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060021 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234013 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234013 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236905 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607638 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235976 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235976 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252912 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607048 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254452 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00252912 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241044 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588416 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244045 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00241044 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248528 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00665912 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246857 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246857 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252624 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676946 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250041 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250041 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00279877 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0066427 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00281053 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00279877 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238293 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677133 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239147 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238293 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250034 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00670317 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250811 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00250034 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248063 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673143 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247346 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00247346 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248197 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00668696 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246731 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246731 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024945 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675138 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248237 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248237 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00257192 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00670192 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254837 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00254837 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024592 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588617 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245393 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00245393 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254885 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00661029 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252078 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252078 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254051 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00671127 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254204 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00254051 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0028065 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00666577 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00281098 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0028065 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239825 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00678317 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239992 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239825 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251349 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673351 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252215 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00251349 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252086 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00681295 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249498 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249498 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250803 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00670255 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251316 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00250803 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251509 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00672935 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250648 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250648 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025711 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00667075 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00256718 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00256718 [04/18/2023-13:39:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:45] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0031354 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676758 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00326628 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0031354 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325039 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0068271 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00325413 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00325039 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0164653 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676052 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0164709 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00676052 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00335266 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598133 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00285897 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00285897 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00357296 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006116 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00358217 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00357296 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00866608 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595333 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00867899 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00595333 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00320599 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00697622 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00323688 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00320599 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0166629 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00700669 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0166268 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00700669 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0032506 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604991 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00324175 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00324175 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00352346 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613162 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00355044 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00352346 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00924314 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591872 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00923686 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00591872 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325953 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00695227 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00326067 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00325953 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0165907 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00701954 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0165465 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00701954 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344403 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617905 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00367695 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00344403 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00373392 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00635886 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00373732 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00373392 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00923257 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611905 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00928172 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00611905 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0032748 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00692985 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00325101 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00325101 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344207 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00708811 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00341932 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00341932 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342814 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605905 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00343173 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00342814 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00376866 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596914 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00379922 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00376866 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.009536 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600781 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00952655 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00600781 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00315687 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602419 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00314017 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00314017 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00327564 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614286 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00327948 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00327564 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0161864 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612857 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0161839 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00612857 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0032065 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00639523 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00296284 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00296284 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00352524 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612171 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00351933 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00351933 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00862333 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618686 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00862037 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00618686 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00329101 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587319 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00328332 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00328332 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00346275 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597543 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00348733 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00346275 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0166629 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611086 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0164683 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00611086 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00341888 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610171 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00341039 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00341039 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00369243 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608876 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00368703 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00368703 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00703216 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0061101 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00705546 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0061101 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00327803 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606229 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00328 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00327803 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034683 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612228 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346373 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00346373 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0166867 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617352 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0167147 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00617352 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00366476 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629366 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00366011 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00366011 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00915114 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00620343 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00918314 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00620343 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0032748 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006028 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00327564 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0032748 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00364297 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605638 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347777 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00347777 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.016734 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608362 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0166923 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00608362 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00340256 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00623523 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0033785 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0033785 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00367121 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621535 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00367437 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00367121 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00919457 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630499 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00921171 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00630499 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326421 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604324 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00326805 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00326421 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00349279 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609086 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347309 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00347309 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0166436 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606781 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0165978 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00606781 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033853 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622748 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00337042 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00337042 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00927714 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611619 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00926371 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00611619 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326462 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603086 [04/18/2023-13:39:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00326244 [04/18/2023-13:39:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00326244 [04/18/2023-13:39:45] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00347657 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598152 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00355111 [04/18/2023-13:39:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00347657 [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:39:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0166055 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607867 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0166507 [04/18/2023-13:39:46] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00607867 [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:39:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00338254 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00641067 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349576 [04/18/2023-13:39:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00338254 [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:39:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00366464 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609238 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00367344 [04/18/2023-13:39:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00366464 [04/18/2023-13:39:46] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning Reformat: Float(102000,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:46] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5_copy_output (Reformat) [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242402 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603695 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240991 [04/18/2023-13:39:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240991 [04/18/2023-13:39:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning Reformat: Float(1,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:46] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5_copy_output (Reformat) [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243099 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00573586 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246321 [04/18/2023-13:39:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00243099 [04/18/2023-13:39:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning Reformat: Float(1:4,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:46] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5_copy_output (Reformat) [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033634 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0442126 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00342607 [04/18/2023-13:39:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0033634 [04/18/2023-13:39:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning Reformat: Float(102000:32,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:46] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5_copy_output (Reformat) [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00840417 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0446503 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00838451 [04/18/2023-13:39:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00838451 [04/18/2023-13:39:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning Reformat: Half(102000,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:46] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5_copy_output (Reformat) [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240488 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621237 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241036 [04/18/2023-13:39:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00240488 [04/18/2023-13:39:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning Reformat: Half(102000:2,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:46] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5_copy_output (Reformat) [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00321676 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0160005 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0032382 [04/18/2023-13:39:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00321676 [04/18/2023-13:39:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning Reformat: Half(1:4,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:46] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5_copy_output (Reformat) [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325579 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0160244 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00324196 [04/18/2023-13:39:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00324196 [04/18/2023-13:39:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning Reformat: Half(1:8,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:46] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5_copy_output (Reformat) [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033174 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0160325 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00333247 [04/18/2023-13:39:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0033174 [04/18/2023-13:39:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning Reformat: Half(1:16,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:46] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5_copy_output (Reformat) [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00411611 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0159883 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409757 [04/18/2023-13:39:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00409757 [04/18/2023-13:39:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,85,1) -> Float(2142000,85,1) *************** [04/18/2023-13:39:46] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5_copy_output (Reformat) [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0072848 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0166446 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00734789 [04/18/2023-13:39:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0072848 [04/18/2023-13:39:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-13:39:46] [V] [TRT] =============== Computing costs for [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning format combination: -> Float(12800,12800,160,2,1) *************** [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning format combination: -> Half(12800,12800,160,2,1) *************** [04/18/2023-13:39:46] [V] [TRT] =============== Computing costs for [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning format combination: -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning format combination: -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:46] [V] [TRT] =============== Computing costs for [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning format combination: -> Float(3200,3200,80,2,1) *************** [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning format combination: -> Half(3200,3200,80,2,1) *************** [04/18/2023-13:39:46] [V] [TRT] =============== Computing costs for [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning format combination: -> Float(6,2,2,2,1) *************** [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning format combination: -> Half(6,2,2,2,1) *************** [04/18/2023-13:39:46] [V] [TRT] =============== Computing costs for [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning format combination: Int8(409600,409600:4,640,1) -> Float(3276800,102400,320,1) *************** [04/18/2023-13:39:46] [V] [TRT] --------------- Timing Runner: model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv (CudaDepthwiseConvolution) [04/18/2023-13:39:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:46] [V] [TRT] --------------- Timing Runner: model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv (CaskFlattenConvolution) [04/18/2023-13:39:46] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:46] [V] [TRT] --------------- Timing Runner: model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv (CaskConvolution) [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 Tactic: 0x127de12a1f1a4809 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x127de12a1f1a4809 Time: 0.111813 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0732069 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.0395337 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.0299063 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-13:39:46] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0372297 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.0727177 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0360571 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 Tactic: 0x1b0534177b414e71 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x1b0534177b414e71 Time: 0.047312 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.0389851 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-13:39:46] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0301056 [04/18/2023-13:39:46] [V] [TRT] Fastest Tactic: 0xfe80445f7bb61a99 Time: 0.0299063 [04/18/2023-13:39:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xfe80445f7bb61a99 [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning format combination: Int8(409600,409600:32,640,1) -> Float(3276800,102400,320,1) *************** [04/18/2023-13:39:46] [V] [TRT] --------------- Timing Runner: model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv (CaskFlattenConvolution) [04/18/2023-13:39:46] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:46] [V] [TRT] --------------- Timing Runner: model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv (CaskConvolution) [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x2bcbba39f608bf10 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x2bcbba39f608bf10 Time: 0.0603063 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x85c1a5f7f239cf84 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x85c1a5f7f239cf84 Time: 0.0550004 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0xac914b235d066808 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0xac914b235d066808 Time: 0.0977646 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0xa8b56a226b057463 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0xa8b56a226b057463 Time: 0.0485227 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x64x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x23b890da05937b9e [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x23b890da05937b9e Time: 0.0553935 [04/18/2023-13:39:46] [V] [TRT] Fastest Tactic: 0xa8b56a226b057463 Time: 0.0485227 [04/18/2023-13:39:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa8b56a226b057463 [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning format combination: Int8(409600,409600:32,640,1) -> Float(102400,102400:32,320,1) *************** [04/18/2023-13:39:46] [V] [TRT] --------------- Timing Runner: model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv (CaskFlattenConvolution) [04/18/2023-13:39:46] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:46] [V] [TRT] --------------- Timing Runner: model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv (CaskConvolution) [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x45f7566cdb2b10fb [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x45f7566cdb2b10fb Time: 0.0643627 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-13:39:46] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.0571809 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea2b7420057a01c1 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0xea2b7420057a01c1 Time: 0.1152 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.0472571 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2d8ab2aa0639fda9 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x2d8ab2aa0639fda9 Time: 0.0479649 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd14bd6d95fefd45e [04/18/2023-13:39:46] [V] [TRT] Tactic: 0xd14bd6d95fefd45e Time: 0.0453383 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.0708526 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.0557181 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.0853691 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x0e07dc8353bf7e9f [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x0e07dc8353bf7e9f Time: 0.0623177 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x55edef142e02adaa [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x55edef142e02adaa Time: 0.0708023 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.117979 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.0735817 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x0edd5d0285e564d4 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x0edd5d0285e564d4 Time: 0.0805303 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xb936321f82fd390c [04/18/2023-13:39:46] [V] [TRT] Tactic: 0xb936321f82fd390c Time: 0.0440514 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.0462263 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.0464457 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xad886d4d69834922 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0xad886d4d69834922 Time: 0.0530042 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0789943 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x47b1629a4bff4800 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x47b1629a4bff4800 Time: 0.0780983 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.0512975 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.0606598 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.0645592 [04/18/2023-13:39:46] [V] [TRT] Fastest Tactic: 0xb936321f82fd390c Time: 0.0440514 [04/18/2023-13:39:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xb936321f82fd390c [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning format combination: Int8(409600,409600:32,640,1) -> Half(102400,102400:32,320,1) *************** [04/18/2023-13:39:46] [V] [TRT] --------------- Timing Runner: model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv (CaskFlattenConvolution) [04/18/2023-13:39:46] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:46] [V] [TRT] --------------- Timing Runner: model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv (CaskConvolution) [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5812ced7874b44d1 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x5812ced7874b44d1 Time: 0.0517013 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x43e3804f158e597d [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x43e3804f158e597d Time: 0.0716069 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x264d83735b1cba13 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x264d83735b1cba13 Time: 0.054749 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3e116db8858d0d41 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x3e116db8858d0d41 Time: 0.085728 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x8f07802f58d278c0 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x8f07802f58d278c0 Time: 0.11792 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x4133eb8759ee0d6d [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x4133eb8759ee0d6d Time: 0.0494781 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xad6872a374321f7e [04/18/2023-13:39:46] [V] [TRT] Tactic: 0xad6872a374321f7e Time: 0.0465406 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xccdb99df0646c7b3 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0xccdb99df0646c7b3 Time: 0.0693059 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xc5159665a920f22c [04/18/2023-13:39:46] [V] [TRT] Tactic: 0xc5159665a920f22c Time: 0.063232 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xd7985d83133bcf37 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0xd7985d83133bcf37 Time: 0.0417006 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x45aada088ffff645 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x45aada088ffff645 Time: 0.115195 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xfa6c413ca4875a2e [04/18/2023-13:39:46] [V] [TRT] Tactic: 0xfa6c413ca4875a2e Time: 0.0691063 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x39d4f216f0f6dbdb [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x39d4f216f0f6dbdb Time: 0.0387291 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xe830ccb2c17abf84 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0xe830ccb2c17abf84 Time: 0.0718994 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x51a916d02de43689 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x51a916d02de43689 Time: 0.0433006 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x4e7f02f91ddf4673 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x4e7f02f91ddf4673 Time: 0.07424 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xaceaca2c82ab40f3 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0xaceaca2c82ab40f3 Time: 0.0450629 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xe266dbc8b588209b [04/18/2023-13:39:46] [V] [TRT] Tactic: 0xe266dbc8b588209b Time: 0.0810423 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb7a90e7097d64877 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0xb7a90e7097d64877 Time: 0.0498971 [04/18/2023-13:39:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xe2bc5a4963d23ad0 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0xe2bc5a4963d23ad0 Time: 0.0557699 [04/18/2023-13:39:46] [V] [TRT] Fastest Tactic: 0x39d4f216f0f6dbdb Time: 0.0387291 [04/18/2023-13:39:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x39d4f216f0f6dbdb [04/18/2023-13:39:46] [V] [TRT] =============== Computing costs for [04/18/2023-13:39:46] [V] [TRT] *************** Autotuning format combination: Float(3276800,102400,320,1) -> Int8(3276800,102400,320,1) *************** [04/18/2023-13:39:46] [V] [TRT] --------------- Timing Runner: PWN(/model.0/act/LeakyRelu) (PointWiseV2) [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0311296 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0278232 [04/18/2023-13:39:46] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0265996 [04/18/2023-13:39:47] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0279893 [04/18/2023-13:39:47] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.026547 [04/18/2023-13:39:47] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0262827 [04/18/2023-13:39:47] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0283086 [04/18/2023-13:39:47] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0268076 [04/18/2023-13:39:47] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0264686 [04/18/2023-13:39:48] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.026509 [04/18/2023-13:39:48] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0311762 [04/18/2023-13:39:48] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.0262827 [04/18/2023-13:39:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [04/18/2023-13:39:48] [V] [TRT] *************** Autotuning format combination: Float(102400,102400:32,320,1) -> Int8(102400,102400:32,320,1) *************** [04/18/2023-13:39:48] [V] [TRT] --------------- Timing Runner: PWN(/model.0/act/LeakyRelu) (PointWiseV2) [04/18/2023-13:39:48] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0267703 [04/18/2023-13:39:48] [V] [TRT] Tactic: 0x000000000000000b Time: 0.026819 [04/18/2023-13:39:48] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0277768 [04/18/2023-13:39:48] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0278674 [04/18/2023-13:39:49] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0275116 [04/18/2023-13:39:49] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0291703 [04/18/2023-13:39:49] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0270385 [04/18/2023-13:39:49] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0277417 [04/18/2023-13:39:50] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0306615 [04/18/2023-13:39:50] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0310126 [04/18/2023-13:39:50] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0270385 [04/18/2023-13:39:50] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0270141 [04/18/2023-13:39:51] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0274712 [04/18/2023-13:39:51] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.027088 [04/18/2023-13:39:51] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.026848 [04/18/2023-13:39:51] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0265509 [04/18/2023-13:39:51] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0272655 [04/18/2023-13:39:52] [V] [TRT] Tactic: 0x000000000000001b Time: 0.028789 [04/18/2023-13:39:52] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0276236 [04/18/2023-13:39:52] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0270385 [04/18/2023-13:39:52] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0264533 [04/18/2023-13:39:52] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.0264533 [04/18/2023-13:39:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:39:52] [V] [TRT] *************** Autotuning format combination: Half(3276800,102400,320,1) -> Int8(3276800,102400,320,1) *************** [04/18/2023-13:39:52] [V] [TRT] --------------- Timing Runner: PWN(/model.0/act/LeakyRelu) (PointWiseV2) [04/18/2023-13:39:52] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0327973 [04/18/2023-13:39:52] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0253836 [04/18/2023-13:39:53] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0205649 [04/18/2023-13:39:53] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.022737 [04/18/2023-13:39:53] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0184914 [04/18/2023-13:39:53] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0169854 [04/18/2023-13:39:53] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0227755 [04/18/2023-13:39:53] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0186189 [04/18/2023-13:39:54] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0172795 [04/18/2023-13:39:54] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0173308 [04/18/2023-13:39:54] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0306505 [04/18/2023-13:39:54] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.0169854 [04/18/2023-13:39:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [04/18/2023-13:39:54] [V] [TRT] *************** Autotuning format combination: Half(102400,102400:32,320,1) -> Int8(102400,102400:32,320,1) *************** [04/18/2023-13:39:54] [V] [TRT] --------------- Timing Runner: PWN(/model.0/act/LeakyRelu) (PointWiseV2) [04/18/2023-13:39:54] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0159802 [04/18/2023-13:39:54] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0163535 [04/18/2023-13:39:54] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0168218 [04/18/2023-13:39:55] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0162865 [04/18/2023-13:39:55] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0193183 [04/18/2023-13:39:55] [V] [TRT] Tactic: 0x000000000000000f Time: 0.01894 [04/18/2023-13:39:55] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0181189 [04/18/2023-13:39:56] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0176513 [04/18/2023-13:39:56] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0187691 [04/18/2023-13:39:56] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0230838 [04/18/2023-13:39:57] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0169529 [04/18/2023-13:39:57] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0173592 [04/18/2023-13:39:57] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0187011 [04/18/2023-13:39:57] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0177768 [04/18/2023-13:39:57] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0168584 [04/18/2023-13:39:57] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0166639 [04/18/2023-13:39:58] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0176635 [04/18/2023-13:39:58] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0184583 [04/18/2023-13:39:58] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0227148 [04/18/2023-13:39:58] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0179669 [04/18/2023-13:39:58] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0176041 [04/18/2023-13:39:58] [V] [TRT] Fastest Tactic: 0x000000000000000a Time: 0.0159802 [04/18/2023-13:39:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000000a [04/18/2023-13:39:58] [V] [TRT] =============== Computing costs for [04/18/2023-13:39:58] [V] [TRT] *************** Autotuning format combination: Int8(3276800,102400,320,1) -> Int8(1638400,25600,160,1) *************** [04/18/2023-13:39:58] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:58] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:58] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:58] [V] [TRT] *************** Autotuning format combination: Int8(819200,102400:4,320,1) -> Int8(409600,25600:4,160,1) *************** [04/18/2023-13:39:58] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:39:58] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:58] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:39:58] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:58] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:58] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:58] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:58] [V] [TRT] *************** Autotuning format combination: Int8(819200,102400:4,320,1) -> Int8(51200,25600:32,160,1) *************** [04/18/2023-13:39:58] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:58] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:58] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:58] [V] [TRT] *************** Autotuning format combination: Int8(102400,102400:32,320,1) -> Int8(51200,25600:32,160,1) *************** [04/18/2023-13:39:58] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:39:58] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:58] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:39:58] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:58] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:39:58] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:58] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:58] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:58] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-13:39:58] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.0266796 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:39:58] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.027965 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:39:58] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0252587 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-13:39:58] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.0250423 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:39:58] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.026429 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-13:39:58] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.0177818 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:39:58] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.0193463 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-13:39:58] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.0288119 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:39:58] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0303689 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:39:58] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0202217 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-13:39:58] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0349915 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-13:39:58] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.0193714 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-13:39:58] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.0211899 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:39:58] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0355767 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-13:39:58] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0337701 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:39:58] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0278918 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:39:58] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0228487 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-13:39:58] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0564663 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:39:58] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0565318 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:39:58] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0241615 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:39:58] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0330606 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:39:58] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0233293 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:39:58] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0347017 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-13:39:58] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.0233202 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:39:58] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.030987 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:39:58] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0337042 [04/18/2023-13:39:58] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.057027 [04/18/2023-13:39:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0394971 [04/18/2023-13:39:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0217868 [04/18/2023-13:39:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.0191634 [04/18/2023-13:39:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0282331 [04/18/2023-13:39:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0227579 [04/18/2023-13:39:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0218384 [04/18/2023-13:39:59] [V] [TRT] Fastest Tactic: 0xa085d13614221ec4 Time: 0.0177818 [04/18/2023-13:39:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa085d13614221ec4 [04/18/2023-13:39:59] [V] [TRT] =============== Computing costs for [04/18/2023-13:39:59] [V] [TRT] *************** Autotuning format combination: Int8(1638400,25600,160,1) -> Int8(3276800,25600,160,1) long-strided *************** [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] *************** Autotuning format combination: Int8(1638400,25600,160,1) -> Int8(819200,25600,160,1) *************** [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] *************** Autotuning format combination: Int8(409600,25600:4,160,1) -> Int8(819200,25600:4,160,1) long-strided *************** [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:39:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:39:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] *************** Autotuning format combination: Int8(409600,25600:4,160,1) -> Int8(102400,25600:32,160,1) long-strided *************** [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] *************** Autotuning format combination: Int8(409600,25600:4,160,1) -> Int8(204800,25600:4,160,1) *************** [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:39:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:39:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] *************** Autotuning format combination: Int8(409600,25600:4,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] *************** Autotuning format combination: Int8(51200,25600:32,160,1) -> Int8(102400,25600:32,160,1) long-strided *************** [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:39:59] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:39:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:39:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.0125672 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.0125356 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0128118 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00935772 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.010059 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.0148073 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.0103311 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.0115404 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.0170458 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0184291 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.0110534 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0126747 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0324224 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00807187 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00869755 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.013423 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.0087516 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.0226273 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.0215967 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0231177 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0333842 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00971672 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.0125455 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00988069 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00903629 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0340891 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00896114 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0181806 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.014656 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0200783 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.0174095 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0124686 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.0120198 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.0127261 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0199983 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0343479 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0258507 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0124343 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.0109964 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0152663 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0195737 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.019072 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0146327 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.0142562 [04/18/2023-13:39:59] [V] [TRT] Fastest Tactic: 0x3321b9c38b0ba08d Time: 0.00807187 [04/18/2023-13:39:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:39:59] [V] [TRT] *************** Autotuning format combination: Int8(51200,25600:32,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:39:59] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:39:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:39:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.0124423 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.0125474 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0130203 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00924486 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0101001 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.0149193 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.010369 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.0115189 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.0165989 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0186103 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.0110906 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0126857 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0326263 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00822578 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00869916 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.0135796 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00874864 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.0225881 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.0216294 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0230779 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0333595 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.0097539 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.0125333 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00987642 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00903971 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0342601 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00895943 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0181794 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0146304 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0202623 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.017408 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0124983 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.0120145 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.012861 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0200817 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0344869 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0259032 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.012437 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.0109398 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0152905 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0197217 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0197526 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0146235 [04/18/2023-13:39:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.0142479 [04/18/2023-13:39:59] [V] [TRT] Fastest Tactic: 0x3321b9c38b0ba08d Time: 0.00822578 [04/18/2023-13:39:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:39:59] [V] [TRT] =============== Computing costs for [04/18/2023-13:39:59] [V] [TRT] *************** Autotuning format combination: Int8(1638400,25600,160,1) -> Int8(819200,25600,160,1) *************** [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] *************** Autotuning format combination: Int8(409600,25600:4,160,1) -> Int8(204800,25600:4,160,1) *************** [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:39:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:39:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] *************** Autotuning format combination: Int8(409600,25600:4,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] *************** Autotuning format combination: Int8(51200,25600:32,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-13:39:59] [V] [TRT] =============== Computing costs for [04/18/2023-13:39:59] [V] [TRT] *************** Autotuning format combination: Int8(819200,25600,160,1) -> Int8(819200,25600,160,1) *************** [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] *************** Autotuning format combination: Int8(204800,25600:4,160,1) -> Int8(204800,25600:4,160,1) *************** [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:39:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:39:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] *************** Autotuning format combination: Int8(204800,25600:4,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] *************** Autotuning format combination: Int8(25600,25600:32,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:39:59] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:39:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:39:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.0150821 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0159817 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0145838 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.020943 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.0233495 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.0155781 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.0169397 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.0279893 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0294034 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0193554 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0330048 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.0178971 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.0113642 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0345527 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0295049 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0167223 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0122827 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0549547 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0544183 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0129745 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0327598 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0213923 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0302153 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.0133926 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0178651 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0298075 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0558324 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0385463 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0209189 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.0181131 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.027264 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.020084 [04/18/2023-13:39:59] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0192366 [04/18/2023-13:39:59] [V] [TRT] Fastest Tactic: 0xb35096a016bb733a Time: 0.0113642 [04/18/2023-13:39:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xb35096a016bb733a [04/18/2023-13:39:59] [V] [TRT] =============== Computing costs for [04/18/2023-13:39:59] [V] [TRT] *************** Autotuning format combination: Int8(819200,25600,160,1) -> Int8(3276800,25600,160,1) long-strided *************** [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] *************** Autotuning format combination: Int8(819200,25600,160,1) -> Int8(819200,25600,160,1) *************** [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] *************** Autotuning format combination: Int8(204800,25600:4,160,1) -> Int8(819200,25600:4,160,1) long-strided *************** [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:39:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:39:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] *************** Autotuning format combination: Int8(204800,25600:4,160,1) -> Int8(102400,25600:32,160,1) long-strided *************** [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] *************** Autotuning format combination: Int8(204800,25600:4,160,1) -> Int8(204800,25600:4,160,1) *************** [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:39:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:39:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] *************** Autotuning format combination: Int8(204800,25600:4,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] *************** Autotuning format combination: Int8(25600,25600:32,160,1) -> Int8(102400,25600:32,160,1) long-strided *************** [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:39:59] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:39:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:39:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:39:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:39:59] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.0153454 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.015971 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0145801 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.0209398 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.0233874 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.0155831 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.0168508 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.0279627 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0293742 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0193463 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0330021 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.0179 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.0113523 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0340745 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.029547 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0167578 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0122789 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0536381 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0545158 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.013009 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0327991 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0213714 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0301934 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.013413 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0179543 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0297838 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0557836 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0384731 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0209189 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.0180903 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0272335 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0201143 [04/18/2023-13:39:59] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-13:39:59] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0192017 [04/18/2023-13:39:59] [V] [TRT] Fastest Tactic: 0xb35096a016bb733a Time: 0.0113523 [04/18/2023-13:39:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xb35096a016bb733a [04/18/2023-13:39:59] [V] [TRT] *************** Autotuning format combination: Int8(25600,25600:32,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-13:40:00] [V] [TRT] =============== Computing costs for [04/18/2023-13:40:00] [V] [TRT] *************** Autotuning format combination: Int8(3276800,25600,160,1) -> Int8(1638400,25600,160,1) *************** [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] *************** Autotuning format combination: Int8(819200,25600:4,160,1) -> Int8(409600,25600:4,160,1) *************** [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:40:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:40:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] *************** Autotuning format combination: Int8(819200,25600:4,160,1) -> Int8(51200,25600:32,160,1) *************** [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] *************** Autotuning format combination: Int8(102400,25600:32,160,1) -> Int8(51200,25600:32,160,1) *************** [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:40:00] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:40:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:40:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.0161529 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.0165877 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0180114 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.016254 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0185583 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.0171281 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.0122533 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.0135372 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.020036 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0216555 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.0133411 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0148919 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0389851 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.0148969 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.0161402 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.0167939 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.0153312 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.0269166 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.0257219 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0271848 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0399234 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.0119444 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.0147122 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0182857 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0169813 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0403874 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0168076 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0215667 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0181074 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0270842 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.0206472 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0199314 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.0142429 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.0153225 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.026624 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0407166 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0299858 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0147301 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.013098 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0183491 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0264533 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.025331 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.018068 [04/18/2023-13:40:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.0178617 [04/18/2023-13:40:00] [V] [TRT] Fastest Tactic: 0x0779fa4ac8f9f2ee Time: 0.0119444 [04/18/2023-13:40:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:40:00] [V] [TRT] =============== Computing costs for [04/18/2023-13:40:00] [V] [TRT] *************** Autotuning format combination: Int8(409600,25600:4,160,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: /model.8/m/MaxPool (TiledPooling) [04/18/2023-13:40:00] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: /model.8/m/MaxPool (CudaPooling) [04/18/2023-13:40:00] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: /model.8/m/MaxPool (CaskPooling) [04/18/2023-13:40:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_CHWPacked_NCxHW4_kMAX Tactic: 0x1f6c40e3e09ec730 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x1f6c40e3e09ec730 Time: 0.00506436 [04/18/2023-13:40:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll6_tThreads256 Tactic: 0xec7cf487c5e61cec [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xec7cf487c5e61cec Time: 0.00629824 [04/18/2023-13:40:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll5_tThreads256 Tactic: 0x185e4d2f4b6d969e [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x185e4d2f4b6d969e Time: 0.00691527 [04/18/2023-13:40:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll8_tThreads128 Tactic: 0xa492ee81d8eb5052 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xa492ee81d8eb5052 Time: 0.00581906 [04/18/2023-13:40:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll3_tThreads256 Tactic: 0x62c39155f9749cff [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x62c39155f9749cff Time: 0.00601105 [04/18/2023-13:40:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll2_tThreads256 Tactic: 0xbf6a632b19f7ef52 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xbf6a632b19f7ef52 Time: 0.00606724 [04/18/2023-13:40:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll6_tThreads128 Tactic: 0x78221da2d2d1bd4f [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x78221da2d2d1bd4f Time: 0.00583552 [04/18/2023-13:40:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll2_tThreads128 Tactic: 0x2b348a0e0ec04ef1 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x2b348a0e0ec04ef1 Time: 0.00546675 [04/18/2023-13:40:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll3_tThreads128 Tactic: 0xf69d7870ee433d5c [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xf69d7870ee433d5c Time: 0.00558945 [04/18/2023-13:40:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll4_tThreads128 Tactic: 0x51a95674bcd94490 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x51a95674bcd94490 Time: 0.00604133 [04/18/2023-13:40:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll7_tThreads256 Tactic: 0x31d506f925656f41 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x31d506f925656f41 Time: 0.00692746 [04/18/2023-13:40:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll8_tThreads256 Tactic: 0x30cc07a4cfdcf1f1 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x30cc07a4cfdcf1f1 Time: 0.00595981 [04/18/2023-13:40:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll1_tThreads128 Tactic: 0xdf1633a6804bc483 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xdf1633a6804bc483 Time: 0.006164 [04/18/2023-13:40:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll7_tThreads128 Tactic: 0xa58befdc3252cee2 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xa58befdc3252cee2 Time: 0.0062885 [04/18/2023-13:40:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll1_tThreads256 Tactic: 0x4b48da83977c6520 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x4b48da83977c6520 Time: 0.00700017 [04/18/2023-13:40:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll4_tThreads256 Tactic: 0xc5f7bf51abeee533 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xc5f7bf51abeee533 Time: 0.006672 [04/18/2023-13:40:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll5_tThreads128 Tactic: 0x8c00a40a5c5a373d [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x8c00a40a5c5a373d Time: 0.00657558 [04/18/2023-13:40:00] [V] [TRT] Fastest Tactic: 0x1f6c40e3e09ec730 Time: 0.00506436 [04/18/2023-13:40:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x1f6c40e3e09ec730 [04/18/2023-13:40:00] [V] [TRT] *************** Autotuning format combination: Int8(51200,25600:32,160,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: /model.8/m/MaxPool (TiledPooling) [04/18/2023-13:40:00] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: /model.8/m/MaxPool (CudaPooling) [04/18/2023-13:40:00] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: /model.8/m/MaxPool (CaskPooling) [04/18/2023-13:40:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm72_xmma_pooling_IMMA_NCxHW32_generic_kMAX Tactic: 0x94215b398b8eb3ba [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x94215b398b8eb3ba Time: 0.00480686 [04/18/2023-13:40:00] [V] [TRT] Fastest Tactic: 0x94215b398b8eb3ba Time: 0.00480686 [04/18/2023-13:40:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x94215b398b8eb3ba [04/18/2023-13:40:00] [V] [TRT] =============== Computing costs for [04/18/2023-13:40:00] [V] [TRT] *************** Autotuning format combination: Int8(409600,6400,80,1) -> Int8(1638400,6400,80,1) long-strided *************** [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] *************** Autotuning format combination: Int8(409600,6400,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(409600,6400:4,80,1) long-strided *************** [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:40:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:40:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(51200,6400:32,80,1) long-strided *************** [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:40:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:40:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Int8(51200,6400:32,80,1) long-strided *************** [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:40:00] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:40:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:40:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00626723 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00632884 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00688022 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00598762 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00640576 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00665205 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00525388 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00554602 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00659117 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00706329 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.0050415 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00536042 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0100699 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00511298 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00559912 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00729897 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00568545 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.0079182 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00766821 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00795606 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0103223 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00518269 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00593518 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00621694 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00554075 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0103856 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00536178 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00692615 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00776517 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.00924371 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00685453 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00659906 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.0052129 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00615124 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.00915143 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0103491 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00862198 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00518237 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00526531 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00658764 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.00903257 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.00868921 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00790689 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00752553 [04/18/2023-13:40:00] [V] [TRT] Fastest Tactic: 0x25bf7139bbd93bc8 Time: 0.0050415 [04/18/2023-13:40:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:40:00] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:40:00] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:40:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:40:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00614133 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00634653 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00686999 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00598019 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00638132 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.0066267 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00527249 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.0055251 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00657413 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00708354 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00500887 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00536703 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.00996876 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00532419 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.0053633 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00721966 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.0057536 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00788788 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00763284 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00807162 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0101632 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00515526 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00594615 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:40:00] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00620324 [04/18/2023-13:40:00] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00556818 [04/18/2023-13:40:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0102808 [04/18/2023-13:40:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00538243 [04/18/2023-13:40:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00691984 [04/18/2023-13:40:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00782508 [04/18/2023-13:40:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.00927343 [04/18/2023-13:40:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.0068049 [04/18/2023-13:40:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00656956 [04/18/2023-13:40:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00520196 [04/18/2023-13:40:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00615086 [04/18/2023-13:40:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.00915829 [04/18/2023-13:40:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0103236 [04/18/2023-13:40:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00861929 [04/18/2023-13:40:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00517812 [04/18/2023-13:40:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00526482 [04/18/2023-13:40:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00656561 [04/18/2023-13:40:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.00901143 [04/18/2023-13:40:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.00882393 [04/18/2023-13:40:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00790232 [04/18/2023-13:40:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00750217 [04/18/2023-13:40:01] [V] [TRT] Fastest Tactic: 0x25bf7139bbd93bc8 Time: 0.00500887 [04/18/2023-13:40:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:40:01] [V] [TRT] =============== Computing costs for [04/18/2023-13:40:01] [V] [TRT] *************** Autotuning format combination: Int8(409600,6400,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:40:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:40:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:40:01] [V] [TRT] =============== Computing costs for [04/18/2023-13:40:01] [V] [TRT] *************** Autotuning format combination: Int8(409600,6400,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:40:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:40:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:40:01] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:40:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:40:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.0119623 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0126602 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0103732 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.011885 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.0121783 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.00877903 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00883523 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.0122571 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0126392 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00786983 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0123859 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.00776469 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.00776878 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0126674 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0182297 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0111374 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00825524 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.01928 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.019584 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00888013 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0133108 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0136769 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0185949 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.0101492 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0135929 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0186137 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0202091 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0138402 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00823492 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00886588 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0121177 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0127387 [04/18/2023-13:40:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0121958 [04/18/2023-13:40:01] [V] [TRT] Fastest Tactic: 0xfbcd5a1da537e27f Time: 0.00776469 [04/18/2023-13:40:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xfbcd5a1da537e27f [04/18/2023-13:40:01] [V] [TRT] =============== Computing costs for [04/18/2023-13:40:01] [V] [TRT] *************** Autotuning format combination: Int8(409600,6400,80,1) -> Int8(1638400,6400,80,1) long-strided *************** [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] *************** Autotuning format combination: Int8(409600,6400,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(409600,6400:4,80,1) long-strided *************** [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:40:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:40:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(51200,6400:32,80,1) long-strided *************** [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:40:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:40:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Int8(51200,6400:32,80,1) long-strided *************** [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:40:01] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:40:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:40:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.0120088 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0126621 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0103621 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.0119219 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.0122514 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.00844155 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00881855 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.0121916 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0126324 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00782773 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0127451 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.00767759 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.00774328 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0127063 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.01822 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0111487 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00826489 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0193046 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0195657 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0088 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.013568 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0137741 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0185971 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.0100456 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0135805 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0185377 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0197663 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0138178 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00824178 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.0088761 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.012133 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0127322 [04/18/2023-13:40:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0121585 [04/18/2023-13:40:01] [V] [TRT] Fastest Tactic: 0xfbcd5a1da537e27f Time: 0.00767759 [04/18/2023-13:40:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xfbcd5a1da537e27f [04/18/2023-13:40:01] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:40:01] [V] [TRT] =============== Computing costs for [04/18/2023-13:40:01] [V] [TRT] *************** Autotuning format combination: Int8(409600,6400:4,80,1) -> Float(819200,6400,80,1) *************** [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:40:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:01] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 0xc25454de2efcccdc [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xc25454de2efcccdc Time: 0.0223634 [04/18/2023-13:40:01] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: 0xff6944b17d5b2e32 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xff6944b17d5b2e32 Time: 0.0222563 [04/18/2023-13:40:01] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0223608 [04/18/2023-13:40:01] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.0232627 [04/18/2023-13:40:01] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.0233574 [04/18/2023-13:40:01] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0226736 [04/18/2023-13:40:01] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.022528 [04/18/2023-13:40:01] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0229499 [04/18/2023-13:40:01] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 0x1db6e8cf1382fbe0 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x1db6e8cf1382fbe0 Time: 0.0223399 [04/18/2023-13:40:01] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: 0xa4ae2d82115c3e83 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xa4ae2d82115c3e83 Time: 0.0223562 [04/18/2023-13:40:01] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.02307 [04/18/2023-13:40:01] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0236447 [04/18/2023-13:40:01] [V] [TRT] Fastest Tactic: 0xff6944b17d5b2e32 Time: 0.0222563 [04/18/2023-13:40:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xff6944b17d5b2e32 [04/18/2023-13:40:01] [V] [TRT] *************** Autotuning format combination: Int8(51200,6400:32,80,1) -> Float(819200,6400,80,1) *************** [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:01] [V] [TRT] --------------- Timing Runner: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:01] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x733ba2a91a48d431 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x733ba2a91a48d431 Time: 0.0180211 [04/18/2023-13:40:01] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0xf04572b287451f42 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0xf04572b287451f42 Time: 0.0200057 [04/18/2023-13:40:01] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-13:40:01] [V] [TRT] Tactic: 0x5e4f6d7c83746fd6 Time: 0.020606 [04/18/2023-13:40:01] [V] [TRT] Fastest Tactic: 0x733ba2a91a48d431 Time: 0.0180211 [04/18/2023-13:40:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x733ba2a91a48d431 [04/18/2023-13:40:01] [V] [TRT] *************** Autotuning format combination: Int8(51200,6400:32,80,1) -> Float(25600,6400:32,80,1) *************** [04/18/2023-13:40:30] [V] [TRT] --------------- Timing Runner: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) (CaskJitConv) [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-13:40:30] [V] [TRT] Tactic: 0xc22b2f91e37e472a Time: 0.0133353 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x716fcb85e712b30e [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x716fcb85e712b30e Time: 0.0163195 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x5e4918ccf433630e [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x5e4918ccf433630e Time: 0.0144992 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xfac85bfa6e8a95c6 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0xfac85bfa6e8a95c6 Time: 0.0153147 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0177493 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x2640501019a61dc2 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x2640501019a61dc2 Time: 0.015552 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.0150043 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xffb9fbd2bfa6c47d [04/18/2023-13:40:30] [V] [TRT] Tactic: 0xffb9fbd2bfa6c47d Time: 0.0159766 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.015685 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x31de506085a332d4 Time: 0.014565 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x599d6bb582ecb830 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x599d6bb582ecb830 Time: 0.0154647 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.0161859 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x601b41d38fc4645b [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x601b41d38fc4645b Time: 0.0147314 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x311b82feb19aef19 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x311b82feb19aef19 Time: 0.0141669 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xd9c6b8a2f7935fa5 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0xd9c6b8a2f7935fa5 Time: 0.0162022 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x4f35593c356e2e7e Time: 0.0144027 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x596666386c88024b [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x596666386c88024b Time: 0.0146309 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0171007 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0149769 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x3ffcb62b1c6bb94f Time: 0.0149952 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcddae68de84cc6ee [04/18/2023-13:40:30] [V] [TRT] Tactic: 0xcddae68de84cc6ee Time: 0.0152005 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.0157842 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdfdddae7a4bcc830 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0xdfdddae7a4bcc830 Time: 0.016961 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xcae7b5888d47fe1f [04/18/2023-13:40:30] [V] [TRT] Tactic: 0xcae7b5888d47fe1f Time: 0.0137804 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x7247cc5dea3981f1 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x7247cc5dea3981f1 Time: 0.0171154 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa5a7024b355e2bbc [04/18/2023-13:40:30] [V] [TRT] Tactic: 0xa5a7024b355e2bbc Time: 0.0143195 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.0144 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.0165912 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x70ff342513dcddd5 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x70ff342513dcddd5 Time: 0.0166222 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.0159421 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.0146574 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3912ca79eb9a8be1 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x3912ca79eb9a8be1 Time: 0.0149609 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5947ea3454b6a27b [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x5947ea3454b6a27b Time: 0.0145897 [04/18/2023-13:40:30] [V] [TRT] Fastest Tactic: 0xc22b2f91e37e472a Time: 0.0133353 [04/18/2023-13:40:30] [V] [TRT] --------------- Timing Runner: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:30] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:30] [V] [TRT] --------------- Timing Runner: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa71946688cad8664 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0xa71946688cad8664 Time: 0.0177331 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x1e55f8b415964e81 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x1e55f8b415964e81 Time: 0.0187411 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-13:40:30] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.0222465 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9003f5f7ff9b1aec [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x9003f5f7ff9b1aec Time: 0.0211024 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9ec201b34455146e [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x9ec201b34455146e Time: 0.0183589 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x91930a570b557437 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x91930a570b557437 Time: 0.0210586 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdf7e1bd6a496d667 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0xdf7e1bd6a496d667 Time: 0.0190343 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6d377e4222886190 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x6d377e4222886190 Time: 0.01956 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x271b998fe31732ef [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x271b998fe31732ef Time: 0.0193417 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.0194766 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x960e9baa2a6cad5b [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x960e9baa2a6cad5b Time: 0.0176615 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.0206289 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x84942841d92b0552 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x84942841d92b0552 Time: 0.0191097 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xbeb5d91e1874a437 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0xbeb5d91e1874a437 Time: 0.0187571 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcd229658c16b33cd [04/18/2023-13:40:30] [V] [TRT] Tactic: 0xcd229658c16b33cd Time: 0.021265 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.0192594 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.0201491 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x33a5c6dd086942c1 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x33a5c6dd086942c1 Time: 0.0187503 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7720f198395e7d3d [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x7720f198395e7d3d Time: 0.0187611 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0214629 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.0189103 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x60b880e28fee7a0c [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x60b880e28fee7a0c Time: 0.0214759 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcf64a2ae51bf6b36 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0xcf64a2ae51bf6b36 Time: 0.020008 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x844ea9c00f711f19 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x844ea9c00f711f19 Time: 0.0196754 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x65fbe45b4cb1d8a5 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x65fbe45b4cb1d8a5 Time: 0.0199497 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.0194349 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.0211683 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5bd8221bd57baf93 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x5bd8221bd57baf93 Time: 0.019504 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.021777 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.0180554 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.0191634 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6e9c17a33c93d9b0 [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x6e9c17a33c93d9b0 Time: 0.0194697 [04/18/2023-13:40:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-13:40:30] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.0194011 [04/18/2023-13:40:30] [V] [TRT] Fastest Tactic: 0x960e9baa2a6cad5b Time: 0.0176615 [04/18/2023-13:40:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0xc22b2f91e37e472a [04/18/2023-13:40:30] [V] [TRT] *************** Autotuning format combination: Int8(51200,6400:32,80,1) -> Half(25600,6400:32,80,1) *************** [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) (CaskJitConv) [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xc22b2f91e37e472a Time: 0.0106896 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x716fcb85e712b30e [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x716fcb85e712b30e Time: 0.0115453 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x5e4918ccf433630e [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x5e4918ccf433630e Time: 0.00929143 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xfac85bfa6e8a95c6 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xfac85bfa6e8a95c6 Time: 0.0118618 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0129177 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x2640501019a61dc2 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x2640501019a61dc2 Time: 0.0116494 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.0145993 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xffb9fbd2bfa6c47d [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xffb9fbd2bfa6c47d Time: 0.0116392 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.0115907 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x31de506085a332d4 Time: 0.0134076 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x599d6bb582ecb830 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x599d6bb582ecb830 Time: 0.0118945 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.0158624 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x601b41d38fc4645b [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x601b41d38fc4645b Time: 0.00955185 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x311b82feb19aef19 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x311b82feb19aef19 Time: 0.0111107 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xd9c6b8a2f7935fa5 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xd9c6b8a2f7935fa5 Time: 0.0124903 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x4f35593c356e2e7e Time: 0.00927543 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x596666386c88024b [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x596666386c88024b Time: 0.0135206 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0123958 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.00999893 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x3ffcb62b1c6bb94f Time: 0.0113734 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcddae68de84cc6ee [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xcddae68de84cc6ee Time: 0.0146085 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.0117718 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdfdddae7a4bcc830 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xdfdddae7a4bcc830 Time: 0.012032 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xcae7b5888d47fe1f [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xcae7b5888d47fe1f Time: 0.0131807 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x7247cc5dea3981f1 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x7247cc5dea3981f1 Time: 0.0123173 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa5a7024b355e2bbc [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xa5a7024b355e2bbc Time: 0.013841 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.0118959 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.0128983 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x70ff342513dcddd5 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x70ff342513dcddd5 Time: 0.0117953 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.0147054 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.00970758 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3912ca79eb9a8be1 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x3912ca79eb9a8be1 Time: 0.0139728 [04/18/2023-13:40:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5947ea3454b6a27b [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x5947ea3454b6a27b Time: 0.00960152 [04/18/2023-13:40:58] [V] [TRT] Fastest Tactic: 0x4f35593c356e2e7e Time: 0.00927543 [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:58] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0x4f35593c356e2e7e [04/18/2023-13:40:58] [V] [TRT] =============== Computing costs for [04/18/2023-13:40:58] [V] [TRT] *************** Autotuning format combination: Float(819200,6400,80,1) -> Float(204800,1600,40,1) *************** [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (TiledPooling) [04/18/2023-13:40:58] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (CudnnPooling) [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.0055047 [04/18/2023-13:40:58] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.0055047 [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (CaskPooling) [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll6_tThreads256 Tactic: 0x60eceb67eff69444 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x60eceb67eff69444 Time: 0.00527608 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll3_tThreads256 Tactic: 0xee538eb5d3641457 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xee538eb5d3641457 Time: 0.00586642 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll7_tThreads128 Tactic: 0x291bf03c1842464a [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x291bf03c1842464a Time: 0.004522 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll5_tThreads256 Tactic: 0x94ce52cf617d1e36 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x94ce52cf617d1e36 Time: 0.0052831 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll8_tThreads256 Tactic: 0xbc5c1844e5cc7959 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xbc5c1844e5cc7959 Time: 0.00520914 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll2_tThreads128 Tactic: 0xa7a495ee24d0c659 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xa7a495ee24d0c659 Time: 0.00572855 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NCHW_Max Tactic: 0xb59f9cfb90407c92 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xb59f9cfb90407c92 Time: 0.00553987 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll8_tThreads128 Tactic: 0x2802f161f2fbd8fa [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x2802f161f2fbd8fa Time: 0.00442514 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll6_tThreads128 Tactic: 0xf4b20242f8c135e7 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xf4b20242f8c135e7 Time: 0.00456657 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_nd_NCDHW_kMAX_kGENERIC_3D_POOLING_MODE_kFLOAT_0 Tactic: 0x5faf4a0a8a5670ed [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x5faf4a0a8a5670ed Time: 0.007712 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll1_tThreads128 Tactic: 0x53862c46aa5b4c2b [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x53862c46aa5b4c2b Time: 0.00854561 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll3_tThreads128 Tactic: 0x7a0d6790c453b5f4 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x7a0d6790c453b5f4 Time: 0.00505096 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll4_tThreads256 Tactic: 0x4967a0b181fe6d9b [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x4967a0b181fe6d9b Time: 0.00544118 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll2_tThreads256 Tactic: 0x33fa7ccb33e767fa [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x33fa7ccb33e767fa Time: 0.0068615 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll4_tThreads128 Tactic: 0xdd39499496c9cc38 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xdd39499496c9cc38 Time: 0.00461331 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll7_tThreads256 Tactic: 0xbd4519190f75e7e9 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xbd4519190f75e7e9 Time: 0.00526988 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll5_tThreads128 Tactic: 0x0090bbea764abf95 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x0090bbea764abf95 Time: 0.004587 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll1_tThreads256 Tactic: 0xc7d8c563bd6ced88 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xc7d8c563bd6ced88 Time: 0.01037 [04/18/2023-13:40:58] [V] [TRT] Fastest Tactic: 0x2802f161f2fbd8fa Time: 0.00442514 [04/18/2023-13:40:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x2802f161f2fbd8fa [04/18/2023-13:40:58] [V] [TRT] *************** Autotuning format combination: Float(204800,1:4,2560,32) -> Float(51200,1:4,1280,32) *************** [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (CaskPooling) [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP32FP32_WINDOWSIZE_0_NOT_PROPAGATE_NAN_2D Tactic: 0xaec8628e8180bced [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xaec8628e8180bced Time: 0.00575159 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP32FP32_WINDOWSIZE_0_PROPAGATE_NAN_2D Tactic: 0x8382d5c464539e87 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x8382d5c464539e87 Time: 0.00586258 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP32FP32_WINDOWSIZE_0_NOT_PROPAGATE_NAN_3D Tactic: 0xfa211b1cdd504de0 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xfa211b1cdd504de0 Time: 0.00600362 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NHWC_Max_CAlign4 Tactic: 0x22fb1bb4a70e340d [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x22fb1bb4a70e340d Time: 0.00809194 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP32FP32_WINDOWSIZE_0_PROPAGATE_NAN_3D Tactic: 0xd76bac5638836f8a [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xd76bac5638836f8a Time: 0.00632904 [04/18/2023-13:40:58] [V] [TRT] Fastest Tactic: 0xaec8628e8180bced Time: 0.00575159 [04/18/2023-13:40:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0xaec8628e8180bced [04/18/2023-13:40:58] [V] [TRT] *************** Autotuning format combination: Half(819200,6400,80,1) -> Half(204800,1600,40,1) *************** [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (TiledPooling) [04/18/2023-13:40:58] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (CudnnPooling) [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.00527853 [04/18/2023-13:40:58] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.00527853 [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (CaskPooling) [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_nd_NCDHW_kMAX_kGENERIC_3D_POOLING_MODE_kHALF_0 Tactic: 0x457fb0a334d63ae2 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x457fb0a334d63ae2 Time: 0.00769155 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_fw_4d_FP16FP32NCHW_Max Tactic: 0xfd3a631f5c3e741e [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xfd3a631f5c3e741e Time: 0.0054505 [04/18/2023-13:40:58] [V] [TRT] Fastest Tactic: 0xfd3a631f5c3e741e Time: 0.0054505 [04/18/2023-13:40:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnPooling Tactic: 0xffffffffffffffff [04/18/2023-13:40:58] [V] [TRT] *************** Autotuning format combination: Half(409600,6400:2,80,1) -> Half(102400,1600:2,40,1) *************** [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (TiledPooling) [04/18/2023-13:40:58] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (CudaPooling) [04/18/2023-13:40:58] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (CaskPooling) [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_CHWPacked_NCxHW2_kMAX Tactic: 0xc8ae100b63fd8921 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xc8ae100b63fd8921 Time: 0.00384132 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll6_tThreads256 Tactic: 0xf90e997ee69ae7fe [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xf90e997ee69ae7fe Time: 0.00468719 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll5_tThreads256 Tactic: 0x0d2c20d668116d8c [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x0d2c20d668116d8c Time: 0.00451643 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll8_tThreads128 Tactic: 0xb1e08378fb97ab40 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xb1e08378fb97ab40 Time: 0.00405029 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll2_tThreads128 Tactic: 0x3e46e7f72dbcb5e3 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x3e46e7f72dbcb5e3 Time: 0.00433008 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll8_tThreads256 Tactic: 0x25be6a5deca00ae3 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x25be6a5deca00ae3 Time: 0.00435491 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll6_tThreads128 Tactic: 0x6d50705bf1ad465d [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x6d50705bf1ad465d Time: 0.00392933 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll7_tThreads256 Tactic: 0x24a76b0006199453 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x24a76b0006199453 Time: 0.00487421 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll4_tThreads128 Tactic: 0x44db3b8d9fa5bf82 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x44db3b8d9fa5bf82 Time: 0.00387311 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll4_tThreads256 Tactic: 0xd085d2a888921e21 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xd085d2a888921e21 Time: 0.00452871 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll1_tThreads128 Tactic: 0xca645e5fa3373f91 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xca645e5fa3373f91 Time: 0.00570549 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll3_tThreads128 Tactic: 0xe3ef1589cd3fc64e [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xe3ef1589cd3fc64e Time: 0.00408152 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll3_tThreads256 Tactic: 0x77b1fcacda0867ed [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x77b1fcacda0867ed Time: 0.00467613 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll1_tThreads256 Tactic: 0x5e3ab77ab4009e32 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x5e3ab77ab4009e32 Time: 0.00678088 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll5_tThreads128 Tactic: 0x9972c9f37f26cc2f [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x9972c9f37f26cc2f Time: 0.00409365 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll7_tThreads128 Tactic: 0xb0f98225112e35f0 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xb0f98225112e35f0 Time: 0.00404724 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll2_tThreads256 Tactic: 0xaa180ed23a8b1440 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xaa180ed23a8b1440 Time: 0.004963 [04/18/2023-13:40:58] [V] [TRT] Fastest Tactic: 0xc8ae100b63fd8921 Time: 0.00384132 [04/18/2023-13:40:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0xc8ae100b63fd8921 [04/18/2023-13:40:58] [V] [TRT] *************** Autotuning format combination: Half(102400,1:8,1280,16) -> Half(25600,1:8,640,16) *************** [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (TiledPooling) [04/18/2023-13:40:58] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (CudaPooling) [04/18/2023-13:40:58] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (CudnnPooling) [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.00562462 [04/18/2023-13:40:58] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.00562462 [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (CaskPooling) [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP16FP32_WINDOWSIZE_0_PROPAGATE_NAN_3D Tactic: 0xaf2cce7cd58b3192 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xaf2cce7cd58b3192 Time: 0.00636144 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP16FP32_WINDOWSIZE_0_NOT_PROPAGATE_NAN_3D Tactic: 0x6cc99546c45a36fc [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x6cc99546c45a36fc Time: 0.00618381 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP16FP32_WINDOWSIZE_0_NOT_PROPAGATE_NAN_2D Tactic: 0x3820ecd4988ac7f1 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x3820ecd4988ac7f1 Time: 0.00577591 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP16FP32_WINDOWSIZE_0_PROPAGATE_NAN_2D Tactic: 0xfbc5b7ee895bc09f [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xfbc5b7ee895bc09f Time: 0.00595733 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_coalescedC_NHWC_kMAX_3_False Tactic: 0xdb415cba6b0e9137 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xdb415cba6b0e9137 Time: 0.00305401 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_coalescedC_NHWC_kMAX_2_False Tactic: 0xf9ae51e35ff7f5db [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xf9ae51e35ff7f5db Time: 0.00303067 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_fw_4d_FP16FP32NHWC_Max_CAlign8 Tactic: 0x6613a704fbea2e33 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x6613a704fbea2e33 Time: 0.00488945 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_fw_4d_FP16FP32NHWC_Max_CAlign4 Tactic: 0xea62e389fb7bcc66 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0xea62e389fb7bcc66 Time: 0.00728754 [04/18/2023-13:40:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_nd_NDHWC_kMAX_kGENERIC_3D_POOLING_MODE_kHALF_3 Tactic: 0x173cb53487e766c4 [04/18/2023-13:40:58] [V] [TRT] Tactic: 0x173cb53487e766c4 Time: 0.00817778 [04/18/2023-13:40:58] [V] [TRT] Fastest Tactic: 0xf9ae51e35ff7f5db Time: 0.00303067 [04/18/2023-13:40:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0xf9ae51e35ff7f5db [04/18/2023-13:40:58] [V] [TRT] =============== Computing costs for [04/18/2023-13:40:58] [V] [TRT] *************** Autotuning format combination: Int8(819200,6400,80,1) -> Int8(819200,6400,80,1) long-strided *************** [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:58] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] *************** Autotuning format combination: Int8(819200,6400,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:58] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Int8(204800,6400:4,80,1) long-strided *************** [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:40:58] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:40:58] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:58] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Int8(25600,6400:32,80,1) long-strided *************** [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:58] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:40:58] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:40:58] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:58] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:58] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] *************** Autotuning format combination: Int8(25600,6400:32,80,1) -> Int8(25600,6400:32,80,1) long-strided *************** [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:40:58] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:40:58] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:40:58] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:58] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:58] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00674286 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00692441 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00739017 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00652177 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00688435 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00705132 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00560088 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00574738 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00710117 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00763044 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00528359 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00562796 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0108793 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00549855 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00583552 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00778394 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00621515 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00829486 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00808406 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00838603 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0109714 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00540969 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00637575 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00684735 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00592073 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0112155 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00591653 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00742126 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00826057 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.010204 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00726171 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00718217 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00574062 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00655771 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0100782 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0109727 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00896914 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00547132 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00552703 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00699363 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.010073 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.00962529 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00836368 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.0080386 [04/18/2023-13:40:59] [V] [TRT] Fastest Tactic: 0x25bf7139bbd93bc8 Time: 0.00528359 [04/18/2023-13:40:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:40:59] [V] [TRT] *************** Autotuning format combination: Int8(25600,6400:32,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:40:59] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:40:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:40:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00674494 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.0069046 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0074208 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00652301 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00685649 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00709094 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.0056109 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00573842 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00709682 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00762923 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.0052993 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00563077 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0107523 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.0054891 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00580773 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00777744 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00621993 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00825981 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00804013 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00838121 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.010942 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00539208 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.0063364 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00684495 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00594944 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0111852 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00593664 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00745691 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00824381 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0102106 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00723863 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00715063 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00549732 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00657475 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.010055 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0109685 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.008966 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00544796 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00554936 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00700495 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0100224 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.00964785 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00843187 [04/18/2023-13:40:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00804165 [04/18/2023-13:40:59] [V] [TRT] Fastest Tactic: 0x25bf7139bbd93bc8 Time: 0.0052993 [04/18/2023-13:40:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:40:59] [V] [TRT] =============== Computing costs for [04/18/2023-13:40:59] [V] [TRT] *************** Autotuning format combination: Int8(204800,1600,40,1) -> Int8(819200,1600,40,1) long-strided *************** [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] *************** Autotuning format combination: Int8(204800,1600,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(204800,1600:4,40,1) long-strided *************** [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:40:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:40:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(25600,1600:32,40,1) long-strided *************** [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:40:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:40:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Int8(25600,1600:32,40,1) long-strided *************** [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:40:59] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:40:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:40:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.0049053 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00501328 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00503535 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00459171 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00484038 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00487406 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00440852 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00467436 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00476251 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00500619 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00480731 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00518171 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.00921886 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00508043 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00546235 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00763236 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00454486 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00761576 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00743131 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00766773 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.00947829 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00426555 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00461301 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00465136 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00560229 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.00964937 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00537464 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00505364 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00820546 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0104758 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00488518 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00539039 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00497561 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.0047043 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0101327 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.00965089 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00826032 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00493084 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00433053 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00471108 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.00997486 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.00967436 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00828013 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00788884 [04/18/2023-13:40:59] [V] [TRT] Fastest Tactic: 0x0779fa4ac8f9f2ee Time: 0.00426555 [04/18/2023-13:40:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:40:59] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:40:59] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:40:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:40:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:40:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:40:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00488701 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00503393 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00502778 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00461014 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00484373 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00484602 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00441254 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00455457 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00476754 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00500792 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00481798 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00512947 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.00926629 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00507429 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00546099 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00758111 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00455029 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.0076634 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00742994 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00770671 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.00948372 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00427052 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.0046779 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00469751 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00564712 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:40:59] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.00965638 [04/18/2023-13:40:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00539022 [04/18/2023-13:41:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00484693 [04/18/2023-13:41:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00816584 [04/18/2023-13:41:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0102815 [04/18/2023-13:41:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.0048512 [04/18/2023-13:41:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00537583 [04/18/2023-13:41:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00511543 [04/18/2023-13:41:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00470666 [04/18/2023-13:41:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0101644 [04/18/2023-13:41:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.00970362 [04/18/2023-13:41:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00823848 [04/18/2023-13:41:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00493588 [04/18/2023-13:41:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00431489 [04/18/2023-13:41:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00473851 [04/18/2023-13:41:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.00998583 [04/18/2023-13:41:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.00969539 [04/18/2023-13:41:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00823238 [04/18/2023-13:41:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00786599 [04/18/2023-13:41:00] [V] [TRT] Fastest Tactic: 0x0779fa4ac8f9f2ee Time: 0.00427052 [04/18/2023-13:41:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:41:00] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:00] [V] [TRT] *************** Autotuning format combination: Int8(204800,1600,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:41:00] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:00] [V] [TRT] *************** Autotuning format combination: Int8(204800,1600,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:41:00] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.00898543 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00932457 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00792156 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.00886911 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.009216 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.0072064 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00758159 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.00938057 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0096256 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00978987 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0163332 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.00942972 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.00964053 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0165811 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.027299 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00880672 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0105251 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0269166 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0271398 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0120347 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0104248 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0191269 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.027699 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.00754815 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.012568 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0280381 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0276792 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0182474 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.010849 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00794971 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00919143 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0171515 [04/18/2023-13:41:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0165171 [04/18/2023-13:41:00] [V] [TRT] Fastest Tactic: 0xa085d13614221ec4 Time: 0.0072064 [04/18/2023-13:41:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa085d13614221ec4 [04/18/2023-13:41:00] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:00] [V] [TRT] *************** Autotuning format combination: Int8(204800,1600,40,1) -> Int8(819200,1600,40,1) long-strided *************** [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] *************** Autotuning format combination: Int8(204800,1600,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(204800,1600:4,40,1) long-strided *************** [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(25600,1600:32,40,1) long-strided *************** [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Int8(25600,1600:32,40,1) long-strided *************** [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:41:00] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.00911057 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.009346 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00789606 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.00884733 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00929057 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.00720709 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00755489 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.009414 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00974232 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0097987 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0164353 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.00952838 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.00966278 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0166928 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0275695 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00875886 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.010528 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0269432 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0270941 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0120533 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0104751 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0190069 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.027664 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.00761528 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0124987 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.028083 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0276754 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0181206 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0107184 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00797257 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00913771 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0171642 [04/18/2023-13:41:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0165171 [04/18/2023-13:41:00] [V] [TRT] Fastest Tactic: 0xa085d13614221ec4 Time: 0.00720709 [04/18/2023-13:41:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa085d13614221ec4 [04/18/2023-13:41:00] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:41:00] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:00] [V] [TRT] *************** Autotuning format combination: Int8(204800,1600:4,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 0xc25454de2efcccdc [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xc25454de2efcccdc Time: 0.0204519 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: 0xff6944b17d5b2e32 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xff6944b17d5b2e32 Time: 0.0198634 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0286894 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.0213577 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.0251368 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0219213 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.028541 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0206472 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 0x1db6e8cf1382fbe0 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x1db6e8cf1382fbe0 Time: 0.028288 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: 0xa4ae2d82115c3e83 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xa4ae2d82115c3e83 Time: 0.0234364 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.0208353 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0255512 [04/18/2023-13:41:00] [V] [TRT] Fastest Tactic: 0xff6944b17d5b2e32 Time: 0.0198634 [04/18/2023-13:41:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xff6944b17d5b2e32 [04/18/2023-13:41:00] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:32,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x733ba2a91a48d431 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x733ba2a91a48d431 Time: 0.0129051 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0xf04572b287451f42 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xf04572b287451f42 Time: 0.0153431 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x5e4f6d7c83746fd6 Time: 0.0177072 [04/18/2023-13:41:00] [V] [TRT] Fastest Tactic: 0x733ba2a91a48d431 Time: 0.0129051 [04/18/2023-13:41:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x733ba2a91a48d431 [04/18/2023-13:41:00] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:32,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (CaskJitConv) [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xc22b2f91e37e472a Time: 0.0103732 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x716fcb85e712b30e [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x716fcb85e712b30e Time: 0.0206687 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x5e4918ccf433630e [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x5e4918ccf433630e Time: 0.0124088 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xfac85bfa6e8a95c6 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xfac85bfa6e8a95c6 Time: 0.0100913 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0217907 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x2640501019a61dc2 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x2640501019a61dc2 Time: 0.0100943 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.0116631 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xffb9fbd2bfa6c47d [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xffb9fbd2bfa6c47d Time: 0.0112316 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.0105972 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x31de506085a332d4 Time: 0.0123996 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x599d6bb582ecb830 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x599d6bb582ecb830 Time: 0.00998613 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.0130942 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x601b41d38fc4645b [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x601b41d38fc4645b Time: 0.0127924 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x311b82feb19aef19 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x311b82feb19aef19 Time: 0.010975 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xd9c6b8a2f7935fa5 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xd9c6b8a2f7935fa5 Time: 0.0113438 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x4f35593c356e2e7e Time: 0.0127025 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x596666386c88024b [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x596666386c88024b Time: 0.0124975 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.021312 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0134388 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x3ffcb62b1c6bb94f Time: 0.00983345 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcddae68de84cc6ee [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xcddae68de84cc6ee Time: 0.0135144 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.0105535 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdfdddae7a4bcc830 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xdfdddae7a4bcc830 Time: 0.02112 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xcae7b5888d47fe1f [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xcae7b5888d47fe1f Time: 0.0120309 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x7247cc5dea3981f1 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x7247cc5dea3981f1 Time: 0.0212323 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa5a7024b355e2bbc [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xa5a7024b355e2bbc Time: 0.0124343 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.0112763 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.0118105 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x70ff342513dcddd5 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x70ff342513dcddd5 Time: 0.02061 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.012472 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.0127398 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3912ca79eb9a8be1 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x3912ca79eb9a8be1 Time: 0.0133112 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5947ea3454b6a27b [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x5947ea3454b6a27b Time: 0.0130818 [04/18/2023-13:41:00] [V] [TRT] Fastest Tactic: 0x3ffcb62b1c6bb94f Time: 0.00983345 [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa71946688cad8664 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xa71946688cad8664 Time: 0.0137995 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x1e55f8b415964e81 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x1e55f8b415964e81 Time: 0.0160213 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.0156818 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9003f5f7ff9b1aec [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x9003f5f7ff9b1aec Time: 0.0239665 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9ec201b34455146e [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x9ec201b34455146e Time: 0.0153321 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x91930a570b557437 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x91930a570b557437 Time: 0.0239665 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdf7e1bd6a496d667 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xdf7e1bd6a496d667 Time: 0.0163962 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6d377e4222886190 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x6d377e4222886190 Time: 0.0168533 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x271b998fe31732ef [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x271b998fe31732ef Time: 0.0132987 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.0156219 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x960e9baa2a6cad5b [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x960e9baa2a6cad5b Time: 0.0137388 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.0157701 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x84942841d92b0552 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x84942841d92b0552 Time: 0.0163627 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xbeb5d91e1874a437 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xbeb5d91e1874a437 Time: 0.016035 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcd229658c16b33cd [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xcd229658c16b33cd Time: 0.024541 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.0134857 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.0137259 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x33a5c6dd086942c1 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x33a5c6dd086942c1 Time: 0.0155374 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7720f198395e7d3d [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x7720f198395e7d3d Time: 0.0131042 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0246187 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.0163495 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x60b880e28fee7a0c [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x60b880e28fee7a0c Time: 0.0244053 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcf64a2ae51bf6b36 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xcf64a2ae51bf6b36 Time: 0.0160386 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x844ea9c00f711f19 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x844ea9c00f711f19 Time: 0.0134279 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x65fbe45b4cb1d8a5 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x65fbe45b4cb1d8a5 Time: 0.0157573 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.0151237 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.0162524 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5bd8221bd57baf93 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x5bd8221bd57baf93 Time: 0.0169062 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0249173 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.0138726 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.016737 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6e9c17a33c93d9b0 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x6e9c17a33c93d9b0 Time: 0.013317 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.0173603 [04/18/2023-13:41:00] [V] [TRT] Fastest Tactic: 0x7720f198395e7d3d Time: 0.0131042 [04/18/2023-13:41:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-13:41:00] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:32,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (CaskJitConv) [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xc22b2f91e37e472a Time: 0.00821664 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x716fcb85e712b30e [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x716fcb85e712b30e Time: 0.0162702 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x5e4918ccf433630e [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x5e4918ccf433630e Time: 0.0103154 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xfac85bfa6e8a95c6 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xfac85bfa6e8a95c6 Time: 0.00802184 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0155771 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x2640501019a61dc2 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x2640501019a61dc2 Time: 0.00689698 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00994469 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xffb9fbd2bfa6c47d [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xffb9fbd2bfa6c47d Time: 0.00798654 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.00739931 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x31de506085a332d4 Time: 0.0102756 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x599d6bb582ecb830 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x599d6bb582ecb830 Time: 0.00733966 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.0114082 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x601b41d38fc4645b [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x601b41d38fc4645b Time: 0.00945057 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x311b82feb19aef19 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x311b82feb19aef19 Time: 0.00787392 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xd9c6b8a2f7935fa5 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xd9c6b8a2f7935fa5 Time: 0.00835149 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x4f35593c356e2e7e Time: 0.00949914 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x596666386c88024b [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x596666386c88024b Time: 0.0102475 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0151735 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0100227 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x3ffcb62b1c6bb94f Time: 0.00719086 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcddae68de84cc6ee [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xcddae68de84cc6ee Time: 0.0118706 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00731794 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdfdddae7a4bcc830 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xdfdddae7a4bcc830 Time: 0.0149326 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xcae7b5888d47fe1f [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xcae7b5888d47fe1f Time: 0.0102527 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x7247cc5dea3981f1 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x7247cc5dea3981f1 Time: 0.0149682 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa5a7024b355e2bbc [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xa5a7024b355e2bbc Time: 0.0107161 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00840847 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.0085717 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x70ff342513dcddd5 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x70ff342513dcddd5 Time: 0.0144334 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.0103494 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.00950857 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3912ca79eb9a8be1 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x3912ca79eb9a8be1 Time: 0.0114106 [04/18/2023-13:41:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5947ea3454b6a27b [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x5947ea3454b6a27b Time: 0.00980114 [04/18/2023-13:41:00] [V] [TRT] Fastest Tactic: 0x2640501019a61dc2 Time: 0.00689698 [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0x2640501019a61dc2 [04/18/2023-13:41:00] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:00] [V] [TRT] *************** Autotuning format combination: Float(409600,1600,40,1) -> Float(102400,400,20,1) *************** [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (TiledPooling) [04/18/2023-13:41:00] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (CudnnPooling) [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.00445257 [04/18/2023-13:41:00] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.00445257 [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (CaskPooling) [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll6_tThreads256 Tactic: 0x60eceb67eff69444 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x60eceb67eff69444 Time: 0.00342313 [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll3_tThreads256 Tactic: 0xee538eb5d3641457 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xee538eb5d3641457 Time: 0.00376 [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll7_tThreads128 Tactic: 0x291bf03c1842464a [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x291bf03c1842464a Time: 0.00339338 [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll5_tThreads256 Tactic: 0x94ce52cf617d1e36 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x94ce52cf617d1e36 Time: 0.0034301 [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll8_tThreads256 Tactic: 0xbc5c1844e5cc7959 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xbc5c1844e5cc7959 Time: 0.0032828 [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll2_tThreads128 Tactic: 0xa7a495ee24d0c659 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xa7a495ee24d0c659 Time: 0.00408725 [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NCHW_Max Tactic: 0xb59f9cfb90407c92 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xb59f9cfb90407c92 Time: 0.00370919 [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll8_tThreads128 Tactic: 0x2802f161f2fbd8fa [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x2802f161f2fbd8fa Time: 0.00331013 [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll6_tThreads128 Tactic: 0xf4b20242f8c135e7 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xf4b20242f8c135e7 Time: 0.00334714 [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_nd_NCDHW_kMAX_kGENERIC_3D_POOLING_MODE_kFLOAT_0 Tactic: 0x5faf4a0a8a5670ed [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x5faf4a0a8a5670ed Time: 0.00467672 [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll1_tThreads128 Tactic: 0x53862c46aa5b4c2b [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x53862c46aa5b4c2b Time: 0.00578999 [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll3_tThreads128 Tactic: 0x7a0d6790c453b5f4 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x7a0d6790c453b5f4 Time: 0.00367097 [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll4_tThreads256 Tactic: 0x4967a0b181fe6d9b [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x4967a0b181fe6d9b Time: 0.00355668 [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll2_tThreads256 Tactic: 0x33fa7ccb33e767fa [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x33fa7ccb33e767fa Time: 0.00407289 [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll4_tThreads128 Tactic: 0xdd39499496c9cc38 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xdd39499496c9cc38 Time: 0.00356415 [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll7_tThreads256 Tactic: 0xbd4519190f75e7e9 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xbd4519190f75e7e9 Time: 0.00329569 [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll5_tThreads128 Tactic: 0x0090bbea764abf95 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x0090bbea764abf95 Time: 0.00344229 [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll1_tThreads256 Tactic: 0xc7d8c563bd6ced88 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xc7d8c563bd6ced88 Time: 0.00577573 [04/18/2023-13:41:00] [V] [TRT] Fastest Tactic: 0xbc5c1844e5cc7959 Time: 0.0032828 [04/18/2023-13:41:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0xbc5c1844e5cc7959 [04/18/2023-13:41:00] [V] [TRT] *************** Autotuning format combination: Float(102400,1:4,2560,64) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (CaskPooling) [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP32FP32_WINDOWSIZE_0_NOT_PROPAGATE_NAN_2D Tactic: 0xaec8628e8180bced [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xaec8628e8180bced Time: 0.003883 [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP32FP32_WINDOWSIZE_0_PROPAGATE_NAN_2D Tactic: 0x8382d5c464539e87 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x8382d5c464539e87 Time: 0.00401867 [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP32FP32_WINDOWSIZE_0_NOT_PROPAGATE_NAN_3D Tactic: 0xfa211b1cdd504de0 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xfa211b1cdd504de0 Time: 0.00405981 [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NHWC_Max_CAlign4 Tactic: 0x22fb1bb4a70e340d [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x22fb1bb4a70e340d Time: 0.00461228 [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP32FP32_WINDOWSIZE_0_PROPAGATE_NAN_3D Tactic: 0xd76bac5638836f8a [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xd76bac5638836f8a Time: 0.00416614 [04/18/2023-13:41:00] [V] [TRT] Fastest Tactic: 0xaec8628e8180bced Time: 0.003883 [04/18/2023-13:41:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0xaec8628e8180bced [04/18/2023-13:41:00] [V] [TRT] *************** Autotuning format combination: Half(409600,1600,40,1) -> Half(102400,400,20,1) *************** [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (TiledPooling) [04/18/2023-13:41:00] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (CudnnPooling) [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.00463086 [04/18/2023-13:41:00] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.00463086 [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (CaskPooling) [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_nd_NCDHW_kMAX_kGENERIC_3D_POOLING_MODE_kHALF_0 Tactic: 0x457fb0a334d63ae2 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0x457fb0a334d63ae2 Time: 0.00458429 [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_fw_4d_FP16FP32NCHW_Max Tactic: 0xfd3a631f5c3e741e [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xfd3a631f5c3e741e Time: 0.00354709 [04/18/2023-13:41:00] [V] [TRT] Fastest Tactic: 0xfd3a631f5c3e741e Time: 0.00354709 [04/18/2023-13:41:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0xfd3a631f5c3e741e [04/18/2023-13:41:00] [V] [TRT] *************** Autotuning format combination: Half(204800,1600:2,40,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (TiledPooling) [04/18/2023-13:41:00] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (CudaPooling) [04/18/2023-13:41:00] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-13:41:00] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (CaskPooling) [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_CHWPacked_NCxHW2_kMAX Tactic: 0xc8ae100b63fd8921 [04/18/2023-13:41:00] [V] [TRT] Tactic: 0xc8ae100b63fd8921 Time: 0.00277899 [04/18/2023-13:41:00] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll6_tThreads256 Tactic: 0xf90e997ee69ae7fe [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xf90e997ee69ae7fe Time: 0.00323891 [04/18/2023-13:41:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll5_tThreads256 Tactic: 0x0d2c20d668116d8c [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x0d2c20d668116d8c Time: 0.00322042 [04/18/2023-13:41:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll8_tThreads128 Tactic: 0xb1e08378fb97ab40 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xb1e08378fb97ab40 Time: 0.00313888 [04/18/2023-13:41:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll2_tThreads128 Tactic: 0x3e46e7f72dbcb5e3 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x3e46e7f72dbcb5e3 Time: 0.00330971 [04/18/2023-13:41:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll8_tThreads256 Tactic: 0x25be6a5deca00ae3 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x25be6a5deca00ae3 Time: 0.00328052 [04/18/2023-13:41:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll6_tThreads128 Tactic: 0x6d50705bf1ad465d [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x6d50705bf1ad465d Time: 0.00312775 [04/18/2023-13:41:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll7_tThreads256 Tactic: 0x24a76b0006199453 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x24a76b0006199453 Time: 0.00314276 [04/18/2023-13:41:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll4_tThreads128 Tactic: 0x44db3b8d9fa5bf82 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x44db3b8d9fa5bf82 Time: 0.00298971 [04/18/2023-13:41:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll4_tThreads256 Tactic: 0xd085d2a888921e21 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xd085d2a888921e21 Time: 0.00296126 [04/18/2023-13:41:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll1_tThreads128 Tactic: 0xca645e5fa3373f91 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xca645e5fa3373f91 Time: 0.00409613 [04/18/2023-13:41:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll3_tThreads128 Tactic: 0xe3ef1589cd3fc64e [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xe3ef1589cd3fc64e Time: 0.00312457 [04/18/2023-13:41:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll3_tThreads256 Tactic: 0x77b1fcacda0867ed [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x77b1fcacda0867ed Time: 0.00327086 [04/18/2023-13:41:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll1_tThreads256 Tactic: 0x5e3ab77ab4009e32 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x5e3ab77ab4009e32 Time: 0.00406717 [04/18/2023-13:41:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll5_tThreads128 Tactic: 0x9972c9f37f26cc2f [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x9972c9f37f26cc2f Time: 0.00315031 [04/18/2023-13:41:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll7_tThreads128 Tactic: 0xb0f98225112e35f0 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xb0f98225112e35f0 Time: 0.0031364 [04/18/2023-13:41:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll2_tThreads256 Tactic: 0xaa180ed23a8b1440 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xaa180ed23a8b1440 Time: 0.00332239 [04/18/2023-13:41:01] [V] [TRT] Fastest Tactic: 0xc8ae100b63fd8921 Time: 0.00277899 [04/18/2023-13:41:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0xc8ae100b63fd8921 [04/18/2023-13:41:01] [V] [TRT] *************** Autotuning format combination: Half(51200,1:8,1280,32) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (TiledPooling) [04/18/2023-13:41:01] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (CudaPooling) [04/18/2023-13:41:01] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (CudnnPooling) [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.00447871 [04/18/2023-13:41:01] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.00447871 [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (CaskPooling) [04/18/2023-13:41:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP16FP32_WINDOWSIZE_0_PROPAGATE_NAN_3D Tactic: 0xaf2cce7cd58b3192 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xaf2cce7cd58b3192 Time: 0.00419108 [04/18/2023-13:41:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP16FP32_WINDOWSIZE_0_NOT_PROPAGATE_NAN_3D Tactic: 0x6cc99546c45a36fc [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x6cc99546c45a36fc Time: 0.0040814 [04/18/2023-13:41:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP16FP32_WINDOWSIZE_0_NOT_PROPAGATE_NAN_2D Tactic: 0x3820ecd4988ac7f1 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x3820ecd4988ac7f1 Time: 0.00390054 [04/18/2023-13:41:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP16FP32_WINDOWSIZE_0_PROPAGATE_NAN_2D Tactic: 0xfbc5b7ee895bc09f [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xfbc5b7ee895bc09f Time: 0.00403708 [04/18/2023-13:41:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_coalescedC_NHWC_kMAX_3_False Tactic: 0xdb415cba6b0e9137 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xdb415cba6b0e9137 Time: 0.00286537 [04/18/2023-13:41:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_coalescedC_NHWC_kMAX_2_False Tactic: 0xf9ae51e35ff7f5db [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xf9ae51e35ff7f5db Time: 0.00270517 [04/18/2023-13:41:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_fw_4d_FP16FP32NHWC_Max_CAlign8 Tactic: 0x6613a704fbea2e33 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x6613a704fbea2e33 Time: 0.00378887 [04/18/2023-13:41:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_fw_4d_FP16FP32NHWC_Max_CAlign4 Tactic: 0xea62e389fb7bcc66 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xea62e389fb7bcc66 Time: 0.00492312 [04/18/2023-13:41:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_nd_NDHWC_kMAX_kGENERIC_3D_POOLING_MODE_kHALF_3 Tactic: 0x173cb53487e766c4 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x173cb53487e766c4 Time: 0.00546709 [04/18/2023-13:41:01] [V] [TRT] Fastest Tactic: 0xf9ae51e35ff7f5db Time: 0.00270517 [04/18/2023-13:41:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0xf9ae51e35ff7f5db [04/18/2023-13:41:01] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:01] [V] [TRT] *************** Autotuning format combination: Int8(409600,1600,40,1) -> Int8(409600,1600,40,1) long-strided *************** [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] *************** Autotuning format combination: Int8(409600,1600,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(102400,1600:4,40,1) long-strided *************** [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(12800,1600:32,40,1) long-strided *************** [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Int8(12800,1600:32,40,1) long-strided *************** [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:41:01] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00587995 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.0057589 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00576933 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00527526 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00565591 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00564466 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00506294 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00523837 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00562268 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00590263 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00558928 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00602705 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0113832 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00612 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00638629 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00883442 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00516163 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00897629 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00873089 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00886992 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0116325 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00482758 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00538616 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00536161 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00662629 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.011815 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00645724 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00568281 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00970941 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0128011 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00571323 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00664125 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00577262 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00555657 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0123112 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0120267 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00951057 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00583022 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00496583 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00544745 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0122956 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0118143 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00961585 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00909971 [04/18/2023-13:41:01] [V] [TRT] Fastest Tactic: 0x0779fa4ac8f9f2ee Time: 0.00482758 [04/18/2023-13:41:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:41:01] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:41:01] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00561987 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00578834 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00580169 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00526629 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00552897 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00562936 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00495969 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00518563 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00555499 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00589714 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.0055796 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00591086 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0115196 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00599105 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00636164 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00887476 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00516457 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00910829 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00873842 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00886938 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0117982 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00483535 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00539361 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00536923 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00660696 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0117753 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00643955 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00568334 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00965303 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0128491 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00575262 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00664229 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00579529 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00552985 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0123147 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0120133 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00951257 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00583058 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00494219 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00543255 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0122564 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0118259 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00966583 [04/18/2023-13:41:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.009094 [04/18/2023-13:41:01] [V] [TRT] Fastest Tactic: 0x0779fa4ac8f9f2ee Time: 0.00483535 [04/18/2023-13:41:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:41:01] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,400,20,1) -> Int8(409600,400,20,1) long-strided *************** [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) long-strided *************** [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(12800,400:32,20,1) long-strided *************** [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) long-strided *************** [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:41:01] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:01] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00444551 [04/18/2023-13:41:01] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00451243 [04/18/2023-13:41:01] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0046 [04/18/2023-13:41:01] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00457643 [04/18/2023-13:41:01] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00490057 [04/18/2023-13:41:01] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00446116 [04/18/2023-13:41:01] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00466699 [04/18/2023-13:41:01] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00482362 [04/18/2023-13:41:01] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00531691 [04/18/2023-13:41:01] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00560756 [04/18/2023-13:41:01] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00536398 [04/18/2023-13:41:01] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00571306 [04/18/2023-13:41:01] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0120629 [04/18/2023-13:41:01] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00572361 [04/18/2023-13:41:01] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00625948 [04/18/2023-13:41:01] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00867496 [04/18/2023-13:41:01] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00456443 [04/18/2023-13:41:01] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00870373 [04/18/2023-13:41:01] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00848511 [04/18/2023-13:41:01] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00880134 [04/18/2023-13:41:01] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0121779 [04/18/2023-13:41:01] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00439259 [04/18/2023-13:41:01] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00422817 [04/18/2023-13:41:01] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:41:01] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0049548 [04/18/2023-13:41:01] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00630122 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0124682 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00633878 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00564097 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00966461 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0127112 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00556536 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00452371 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00556026 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00426971 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0123611 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0125101 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00950972 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.006044 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00478872 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00456243 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0123859 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0118734 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00939686 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00894743 [04/18/2023-13:41:02] [V] [TRT] Fastest Tactic: 0x4862d9a1cd4ec818 Time: 0.00422817 [04/18/2023-13:41:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:41:02] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:41:02] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00459014 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00451914 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00489463 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00458829 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00473364 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00458971 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00455886 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00470503 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00530252 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0055724 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00536212 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00571794 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0121448 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.0057664 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00603181 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00865667 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00449514 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00873923 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00850797 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00883254 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0123547 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00460129 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00425129 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00496946 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00630082 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0123227 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00656831 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00566277 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00967924 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0127173 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.0056531 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00452029 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00556255 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00426165 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0124945 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0123063 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00965333 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00576366 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00476434 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.004559 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0122945 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0119234 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00939172 [04/18/2023-13:41:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.008998 [04/18/2023-13:41:02] [V] [TRT] Fastest Tactic: 0x4862d9a1cd4ec818 Time: 0.00425129 [04/18/2023-13:41:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:41:02] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:02] [V] [TRT] *************** Autotuning format combination: Int8(102400,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:41:02] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:02] [V] [TRT] *************** Autotuning format combination: Int8(102400,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:41:02] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.00859025 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00869835 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0100102 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.00821283 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00839238 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.0102044 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.0106162 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.0140347 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0143493 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0148535 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0260152 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.0144343 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.0145554 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0263573 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0467383 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0128907 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0161402 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.046592 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0466194 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0189394 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0161991 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0306377 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0471051 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.00924343 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0102273 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0479817 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0479649 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0287351 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0167548 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.0116564 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0105891 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0268693 [04/18/2023-13:41:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0262781 [04/18/2023-13:41:02] [V] [TRT] Fastest Tactic: 0x83caf00de690c0ec Time: 0.00821283 [04/18/2023-13:41:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x83caf00de690c0ec [04/18/2023-13:41:02] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:02] [V] [TRT] *************** Autotuning format combination: Int8(102400,400,20,1) -> Int8(409600,400,20,1) long-strided *************** [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] *************** Autotuning format combination: Int8(102400,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) long-strided *************** [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(12800,400:32,20,1) long-strided *************** [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) long-strided *************** [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:41:02] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.00970849 [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00986088 [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0113575 [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.00928571 [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00969722 [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.0115291 [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.012096 [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.0159263 [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0163246 [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0164653 [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0292361 [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.0160945 [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.0164526 [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0296338 [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0525653 [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0147502 [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0180297 [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0528579 [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0526552 [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:41:02] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0213545 [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0181943 [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0345271 [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0530118 [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.0106093 [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0116677 [04/18/2023-13:41:02] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:41:02] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0540648 [04/18/2023-13:41:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0538849 [04/18/2023-13:41:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0323291 [04/18/2023-13:41:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0187606 [04/18/2023-13:41:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.0132567 [04/18/2023-13:41:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0120084 [04/18/2023-13:41:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0301934 [04/18/2023-13:41:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0294619 [04/18/2023-13:41:03] [V] [TRT] Fastest Tactic: 0x83caf00de690c0ec Time: 0.00928571 [04/18/2023-13:41:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x83caf00de690c0ec [04/18/2023-13:41:03] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:41:03] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:03] [V] [TRT] *************** Autotuning format combination: Int8(409600,400,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] *************** Autotuning format combination: Int8(102400,400:4,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:03] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] *************** Autotuning format combination: Int8(102400,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] *************** Autotuning format combination: Int8(12800,400:32,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:41:03] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:03] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.0113143 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.0114103 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0109322 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.0100733 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0103984 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00989135 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00811987 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00838806 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00966583 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00997973 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00978956 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0103935 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0277524 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.0111381 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.0113284 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.017021 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00985905 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.0171017 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.0168803 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0172455 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0280891 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00792445 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00964541 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0101925 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0115488 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0281356 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0124149 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0105499 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0194166 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0288731 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.0098688 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0136856 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.0100184 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.0097728 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.028429 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0282552 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0185086 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0108669 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00829537 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00985631 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0282575 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0280404 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.017884 [04/18/2023-13:41:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.017378 [04/18/2023-13:41:03] [V] [TRT] Fastest Tactic: 0x0779fa4ac8f9f2ee Time: 0.00792445 [04/18/2023-13:41:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:41:03] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:03] [V] [TRT] *************** Autotuning format combination: Int8(204800,400,20,1) -> Int8(204800,400,20,1) long-strided *************** [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] *************** Autotuning format combination: Int8(204800,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(51200,400:4,20,1) long-strided *************** [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:03] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(6400,400:32,20,1) long-strided *************** [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:03] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Int8(6400,400:32,20,1) long-strided *************** [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:41:03] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:03] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00592165 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00589038 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00604476 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.0058187 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00607867 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00563569 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00588837 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00610362 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00731223 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00759603 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.0072512 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00786863 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.018052 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00771248 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00801981 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.0119882 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00586149 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.0122865 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.0120792 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0124107 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0185771 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00587282 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00537803 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0067306 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00844074 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.018816 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00883899 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00775844 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0137093 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0193109 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00741166 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0060301 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00752313 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00546709 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0185634 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0186514 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0132484 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00805537 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00635886 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0060621 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0182366 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0179737 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0128838 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.0121627 [04/18/2023-13:41:03] [V] [TRT] Fastest Tactic: 0x4862d9a1cd4ec818 Time: 0.00537803 [04/18/2023-13:41:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:41:03] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:41:03] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:03] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00571447 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00588105 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00604152 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00582071 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00608781 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00563657 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00595054 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00610667 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00727474 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00757943 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.0072624 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00786045 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0179903 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00761985 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00803556 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.0118569 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00567912 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.0123002 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.0118917 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:41:03] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0122979 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:41:03] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0183834 [04/18/2023-13:41:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00582729 [04/18/2023-13:41:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00536296 [04/18/2023-13:41:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00672748 [04/18/2023-13:41:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00832914 [04/18/2023-13:41:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0184869 [04/18/2023-13:41:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00879597 [04/18/2023-13:41:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00775723 [04/18/2023-13:41:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0136091 [04/18/2023-13:41:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.018984 [04/18/2023-13:41:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00736708 [04/18/2023-13:41:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00601391 [04/18/2023-13:41:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00742011 [04/18/2023-13:41:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00545693 [04/18/2023-13:41:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.018528 [04/18/2023-13:41:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0184686 [04/18/2023-13:41:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0131811 [04/18/2023-13:41:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00805384 [04/18/2023-13:41:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00635925 [04/18/2023-13:41:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00607505 [04/18/2023-13:41:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0182297 [04/18/2023-13:41:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0179383 [04/18/2023-13:41:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0129093 [04/18/2023-13:41:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.0121611 [04/18/2023-13:41:04] [V] [TRT] Fastest Tactic: 0x4862d9a1cd4ec818 Time: 0.00536296 [04/18/2023-13:41:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:41:04] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(204800,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:04] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:41:04] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) long-strided *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool (TiledPooling) [04/18/2023-13:41:04] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool (CudaPooling) [04/18/2023-13:41:04] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool (CaskPooling) [04/18/2023-13:41:04] [V] [TRT] /model.31/m/MaxPool Set Tactic Name: sm50_xmma_pooling_CHWPacked_NCxHW4_kMAX Tactic: 0x1f6c40e3e09ec730 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x1f6c40e3e09ec730 Time: 0.0054764 [04/18/2023-13:41:04] [V] [TRT] Fastest Tactic: 0x1f6c40e3e09ec730 Time: 0.0054764 [04/18/2023-13:41:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x1f6c40e3e09ec730 [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool (TiledPooling) [04/18/2023-13:41:04] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool (CudaPooling) [04/18/2023-13:41:04] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool (CaskPooling) [04/18/2023-13:41:04] [V] [TRT] /model.31/m/MaxPool Set Tactic Name: sm50_xmma_pooling_CHWPacked_NCxHW4_kMAX Tactic: 0x1f6c40e3e09ec730 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x1f6c40e3e09ec730 Time: 0.00549574 [04/18/2023-13:41:04] [V] [TRT] Fastest Tactic: 0x1f6c40e3e09ec730 Time: 0.00549574 [04/18/2023-13:41:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x1f6c40e3e09ec730 [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) long-strided *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool (TiledPooling) [04/18/2023-13:41:04] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool (CudaPooling) [04/18/2023-13:41:04] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool (CaskPooling) [04/18/2023-13:41:04] [V] [TRT] /model.31/m/MaxPool Set Tactic Name: sm72_xmma_pooling_IMMA_NCxHW32_generic_kMAX Tactic: 0x94215b398b8eb3ba [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x94215b398b8eb3ba Time: 0.00632209 [04/18/2023-13:41:04] [V] [TRT] Fastest Tactic: 0x94215b398b8eb3ba Time: 0.00632209 [04/18/2023-13:41:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x94215b398b8eb3ba [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool (TiledPooling) [04/18/2023-13:41:04] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool (CudaPooling) [04/18/2023-13:41:04] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool (CaskPooling) [04/18/2023-13:41:04] [V] [TRT] /model.31/m/MaxPool Set Tactic Name: sm72_xmma_pooling_IMMA_NCxHW32_generic_kMAX Tactic: 0x94215b398b8eb3ba [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x94215b398b8eb3ba Time: 0.00630937 [04/18/2023-13:41:04] [V] [TRT] Fastest Tactic: 0x94215b398b8eb3ba Time: 0.00630937 [04/18/2023-13:41:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x94215b398b8eb3ba [04/18/2023-13:41:04] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) long-strided *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.32/m/MaxPool (TiledPooling) [04/18/2023-13:41:04] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.32/m/MaxPool (CudaPooling) [04/18/2023-13:41:04] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.32/m/MaxPool (CaskPooling) [04/18/2023-13:41:04] [V] [TRT] /model.32/m/MaxPool Set Tactic Name: sm50_xmma_pooling_CHWPacked_NCxHW4_kMAX Tactic: 0x1f6c40e3e09ec730 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x1f6c40e3e09ec730 Time: 0.0111304 [04/18/2023-13:41:04] [V] [TRT] Fastest Tactic: 0x1f6c40e3e09ec730 Time: 0.0111304 [04/18/2023-13:41:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x1f6c40e3e09ec730 [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.32/m/MaxPool (TiledPooling) [04/18/2023-13:41:04] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.32/m/MaxPool (CudaPooling) [04/18/2023-13:41:04] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.32/m/MaxPool (CaskPooling) [04/18/2023-13:41:04] [V] [TRT] /model.32/m/MaxPool Set Tactic Name: sm50_xmma_pooling_CHWPacked_NCxHW4_kMAX Tactic: 0x1f6c40e3e09ec730 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x1f6c40e3e09ec730 Time: 0.0111195 [04/18/2023-13:41:04] [V] [TRT] Fastest Tactic: 0x1f6c40e3e09ec730 Time: 0.0111195 [04/18/2023-13:41:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x1f6c40e3e09ec730 [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) long-strided *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.32/m/MaxPool (TiledPooling) [04/18/2023-13:41:04] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.32/m/MaxPool (CudaPooling) [04/18/2023-13:41:04] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.32/m/MaxPool (CaskPooling) [04/18/2023-13:41:04] [V] [TRT] /model.32/m/MaxPool Set Tactic Name: sm72_xmma_pooling_IMMA_NCxHW32_generic_kMAX Tactic: 0x94215b398b8eb3ba [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x94215b398b8eb3ba Time: 0.0122922 [04/18/2023-13:41:04] [V] [TRT] Fastest Tactic: 0x94215b398b8eb3ba Time: 0.0122922 [04/18/2023-13:41:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x94215b398b8eb3ba [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.32/m/MaxPool (TiledPooling) [04/18/2023-13:41:04] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.32/m/MaxPool (CudaPooling) [04/18/2023-13:41:04] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.32/m/MaxPool (CaskPooling) [04/18/2023-13:41:04] [V] [TRT] /model.32/m/MaxPool Set Tactic Name: sm72_xmma_pooling_IMMA_NCxHW32_generic_kMAX Tactic: 0x94215b398b8eb3ba [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x94215b398b8eb3ba Time: 0.0123059 [04/18/2023-13:41:04] [V] [TRT] Fastest Tactic: 0x94215b398b8eb3ba Time: 0.0123059 [04/18/2023-13:41:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x94215b398b8eb3ba [04/18/2023-13:41:04] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) long-strided *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.33/m/MaxPool (TiledPooling) [04/18/2023-13:41:04] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.33/m/MaxPool (CudaPooling) [04/18/2023-13:41:04] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.33/m/MaxPool (CaskPooling) [04/18/2023-13:41:04] [V] [TRT] /model.33/m/MaxPool Set Tactic Name: sm50_xmma_pooling_CHWPacked_NCxHW4_kMAX Tactic: 0x1f6c40e3e09ec730 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x1f6c40e3e09ec730 Time: 0.0190663 [04/18/2023-13:41:04] [V] [TRT] Fastest Tactic: 0x1f6c40e3e09ec730 Time: 0.0190663 [04/18/2023-13:41:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x1f6c40e3e09ec730 [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.33/m/MaxPool (TiledPooling) [04/18/2023-13:41:04] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.33/m/MaxPool (CudaPooling) [04/18/2023-13:41:04] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.33/m/MaxPool (CaskPooling) [04/18/2023-13:41:04] [V] [TRT] /model.33/m/MaxPool Set Tactic Name: sm50_xmma_pooling_CHWPacked_NCxHW4_kMAX Tactic: 0x1f6c40e3e09ec730 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x1f6c40e3e09ec730 Time: 0.0190571 [04/18/2023-13:41:04] [V] [TRT] Fastest Tactic: 0x1f6c40e3e09ec730 Time: 0.0190571 [04/18/2023-13:41:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x1f6c40e3e09ec730 [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) long-strided *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.33/m/MaxPool (TiledPooling) [04/18/2023-13:41:04] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.33/m/MaxPool (CudaPooling) [04/18/2023-13:41:04] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.33/m/MaxPool (CaskPooling) [04/18/2023-13:41:04] [V] [TRT] /model.33/m/MaxPool Set Tactic Name: sm72_xmma_pooling_IMMA_NCxHW32_generic_kMAX Tactic: 0x94215b398b8eb3ba [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x94215b398b8eb3ba Time: 0.0207053 [04/18/2023-13:41:04] [V] [TRT] Fastest Tactic: 0x94215b398b8eb3ba Time: 0.0207053 [04/18/2023-13:41:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x94215b398b8eb3ba [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.33/m/MaxPool (TiledPooling) [04/18/2023-13:41:04] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.33/m/MaxPool (CudaPooling) [04/18/2023-13:41:04] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: /model.33/m/MaxPool (CaskPooling) [04/18/2023-13:41:04] [V] [TRT] /model.33/m/MaxPool Set Tactic Name: sm72_xmma_pooling_IMMA_NCxHW32_generic_kMAX Tactic: 0x94215b398b8eb3ba [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x94215b398b8eb3ba Time: 0.0206263 [04/18/2023-13:41:04] [V] [TRT] Fastest Tactic: 0x94215b398b8eb3ba Time: 0.0206263 [04/18/2023-13:41:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x94215b398b8eb3ba [04/18/2023-13:41:04] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(409600,400,20,1) -> Int8(204800,400,20,1) long-strided *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(409600,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(102400,400:4,20,1) -> Int8(51200,400:4,20,1) long-strided *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:04] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(102400,400:4,20,1) -> Int8(6400,400:32,20,1) long-strided *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(102400,400:4,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:04] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(102400,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(12800,400:32,20,1) -> Int8(6400,400:32,20,1) long-strided *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:41:04] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:04] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00781594 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00801905 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00796368 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00720846 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00755585 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00698689 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00718309 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00762538 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00964876 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00994743 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00977889 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0102795 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0278324 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.0104124 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.0107729 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.0168264 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00709899 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.0169417 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.0168594 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0170885 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0283497 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.0070892 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.0067626 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00865802 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0110738 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.028336 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0121417 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0104457 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0192891 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0288768 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00997303 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00786815 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.0100501 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00684278 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0284091 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0282088 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0182657 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0107233 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00805867 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00754358 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0280861 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.02784 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0177981 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.0171947 [04/18/2023-13:41:04] [V] [TRT] Fastest Tactic: 0x4862d9a1cd4ec818 Time: 0.0067626 [04/18/2023-13:41:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(12800,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:41:04] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:04] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00781065 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00813054 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0079614 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.0072832 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00750171 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00698384 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00717646 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00759916 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.0096192 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00993402 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.0098051 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0102491 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0278674 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.0104278 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.0107843 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.0168422 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00705633 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.0169834 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.0166603 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0171307 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.028157 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.0070326 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00676488 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00863408 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0110516 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.028141 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0122747 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0104673 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0193154 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0288667 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00979048 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00787729 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00997669 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00683842 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0284335 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0282552 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.018304 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0107265 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00807924 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00753564 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0281547 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0278423 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0178504 [04/18/2023-13:41:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.0171901 [04/18/2023-13:41:04] [V] [TRT] Fastest Tactic: 0x4862d9a1cd4ec818 Time: 0.00676488 [04/18/2023-13:41:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:41:04] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Float(204800,400,20,1) long-strided *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 0xc25454de2efcccdc [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xc25454de2efcccdc Time: 0.0210377 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: 0xff6944b17d5b2e32 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xff6944b17d5b2e32 Time: 0.0211246 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0310418 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.0227161 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.0253074 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0229251 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.0309541 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0212323 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 0x1db6e8cf1382fbe0 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x1db6e8cf1382fbe0 Time: 0.0305445 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: 0xa4ae2d82115c3e83 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xa4ae2d82115c3e83 Time: 0.0246004 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.0221518 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0263307 [04/18/2023-13:41:04] [V] [TRT] Fastest Tactic: 0xc25454de2efcccdc Time: 0.0210377 [04/18/2023-13:41:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xc25454de2efcccdc [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Float(102400,400,20,1) *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 0xc25454de2efcccdc [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xc25454de2efcccdc Time: 0.0209874 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: 0xff6944b17d5b2e32 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xff6944b17d5b2e32 Time: 0.0210795 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0311909 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.0225985 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.0253493 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0227971 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.0307785 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.021086 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 0x1db6e8cf1382fbe0 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x1db6e8cf1382fbe0 Time: 0.0305381 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: 0xa4ae2d82115c3e83 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xa4ae2d82115c3e83 Time: 0.0246301 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.0220552 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0261783 [04/18/2023-13:41:04] [V] [TRT] Fastest Tactic: 0xc25454de2efcccdc Time: 0.0209874 [04/18/2023-13:41:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xc25454de2efcccdc [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Float(204800,400,20,1) long-strided *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x733ba2a91a48d431 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x733ba2a91a48d431 Time: 0.00969387 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0xf04572b287451f42 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xf04572b287451f42 Time: 0.0125531 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x5e4f6d7c83746fd6 Time: 0.00956099 [04/18/2023-13:41:04] [V] [TRT] Fastest Tactic: 0x5e4f6d7c83746fd6 Time: 0.00956099 [04/18/2023-13:41:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-13:41:04] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Float(6400,400:32,20,1) long-strided *************** [04/18/2023-13:41:04] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskJitConv) [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xc22b2f91e37e472a Time: 0.0061379 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x716fcb85e712b30e [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x716fcb85e712b30e Time: 0.0201914 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x5e4918ccf433630e [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x5e4918ccf433630e Time: 0.0121665 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xfac85bfa6e8a95c6 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xfac85bfa6e8a95c6 Time: 0.00854911 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0215242 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x2640501019a61dc2 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x2640501019a61dc2 Time: 0.00823416 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-13:41:04] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00613238 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xffb9fbd2bfa6c47d [04/18/2023-13:41:04] [V] [TRT] Tactic: 0xffb9fbd2bfa6c47d Time: 0.00859563 [04/18/2023-13:41:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.00871637 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x31de506085a332d4 Time: 0.00589678 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x599d6bb582ecb830 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x599d6bb582ecb830 Time: 0.00811581 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00634892 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x601b41d38fc4645b [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x601b41d38fc4645b Time: 0.012453 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x311b82feb19aef19 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x311b82feb19aef19 Time: 0.0064324 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xd9c6b8a2f7935fa5 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xd9c6b8a2f7935fa5 Time: 0.00888739 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x4f35593c356e2e7e Time: 0.0124834 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x596666386c88024b [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x596666386c88024b Time: 0.00608686 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0209398 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0130946 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x3ffcb62b1c6bb94f Time: 0.00798984 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcddae68de84cc6ee [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xcddae68de84cc6ee Time: 0.00610667 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00843187 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdfdddae7a4bcc830 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xdfdddae7a4bcc830 Time: 0.0207262 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xcae7b5888d47fe1f [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xcae7b5888d47fe1f Time: 0.00565697 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x7247cc5dea3981f1 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x7247cc5dea3981f1 Time: 0.02109 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa5a7024b355e2bbc [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xa5a7024b355e2bbc Time: 0.00584448 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00668945 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.00911543 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x70ff342513dcddd5 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x70ff342513dcddd5 Time: 0.0206949 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00613295 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.0124251 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3912ca79eb9a8be1 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x3912ca79eb9a8be1 Time: 0.00599676 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5947ea3454b6a27b [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x5947ea3454b6a27b Time: 0.0128415 [04/18/2023-13:41:05] [V] [TRT] Fastest Tactic: 0xcae7b5888d47fe1f Time: 0.00565697 [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa71946688cad8664 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xa71946688cad8664 Time: 0.00879086 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x1e55f8b415964e81 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x1e55f8b415964e81 Time: 0.0152549 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.0127977 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9003f5f7ff9b1aec [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x9003f5f7ff9b1aec Time: 0.0231105 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9ec201b34455146e [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x9ec201b34455146e Time: 0.00845714 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x91930a570b557437 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x91930a570b557437 Time: 0.0231504 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdf7e1bd6a496d667 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xdf7e1bd6a496d667 Time: 0.0151506 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6d377e4222886190 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x6d377e4222886190 Time: 0.00867792 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x271b998fe31732ef [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x271b998fe31732ef Time: 0.0107559 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.00914914 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x960e9baa2a6cad5b [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x960e9baa2a6cad5b Time: 0.00856955 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.00847408 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x84942841d92b0552 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x84942841d92b0552 Time: 0.0153797 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xbeb5d91e1874a437 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xbeb5d91e1874a437 Time: 0.0147977 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcd229658c16b33cd [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xcd229658c16b33cd Time: 0.0234638 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.011084 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.010734 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x33a5c6dd086942c1 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x33a5c6dd086942c1 Time: 0.00825422 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7720f198395e7d3d [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x7720f198395e7d3d Time: 0.010543 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0234684 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.0150432 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x60b880e28fee7a0c [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x60b880e28fee7a0c Time: 0.0234266 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcf64a2ae51bf6b36 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xcf64a2ae51bf6b36 Time: 0.00833803 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x844ea9c00f711f19 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x844ea9c00f711f19 Time: 0.0106162 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x65fbe45b4cb1d8a5 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x65fbe45b4cb1d8a5 Time: 0.00829791 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.00846144 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.00886965 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5bd8221bd57baf93 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x5bd8221bd57baf93 Time: 0.00867146 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0238926 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.00916571 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.0154866 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6e9c17a33c93d9b0 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x6e9c17a33c93d9b0 Time: 0.0105117 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.0162702 [04/18/2023-13:41:05] [V] [TRT] Fastest Tactic: 0x33a5c6dd086942c1 Time: 0.00825422 [04/18/2023-13:41:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0xcae7b5888d47fe1f [04/18/2023-13:41:05] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Half(6400,400:32,20,1) long-strided *************** [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskJitConv) [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xc22b2f91e37e472a Time: 0.00567578 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x716fcb85e712b30e [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x716fcb85e712b30e Time: 0.015907 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x5e4918ccf433630e [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x5e4918ccf433630e Time: 0.01014 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xfac85bfa6e8a95c6 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xfac85bfa6e8a95c6 Time: 0.00762081 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0171804 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x2640501019a61dc2 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x2640501019a61dc2 Time: 0.00718331 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00599086 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xffb9fbd2bfa6c47d [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xffb9fbd2bfa6c47d Time: 0.00759892 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.00772162 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x31de506085a332d4 Time: 0.00558892 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x599d6bb582ecb830 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x599d6bb582ecb830 Time: 0.0073648 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00617009 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x601b41d38fc4645b [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x601b41d38fc4645b Time: 0.0104728 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x311b82feb19aef19 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x311b82feb19aef19 Time: 0.00589916 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xd9c6b8a2f7935fa5 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xd9c6b8a2f7935fa5 Time: 0.00805435 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x4f35593c356e2e7e Time: 0.0105136 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x596666386c88024b [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x596666386c88024b Time: 0.00564958 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0165333 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0110991 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x3ffcb62b1c6bb94f Time: 0.00729966 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcddae68de84cc6ee [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xcddae68de84cc6ee Time: 0.00590592 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00745486 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdfdddae7a4bcc830 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xdfdddae7a4bcc830 Time: 0.0163977 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xcae7b5888d47fe1f [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xcae7b5888d47fe1f Time: 0.00575744 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x7247cc5dea3981f1 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x7247cc5dea3981f1 Time: 0.0167375 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa5a7024b355e2bbc [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xa5a7024b355e2bbc Time: 0.00575909 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.0063992 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.00831695 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x70ff342513dcddd5 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x70ff342513dcddd5 Time: 0.0162834 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00564466 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.0105166 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3912ca79eb9a8be1 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x3912ca79eb9a8be1 Time: 0.0057062 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5947ea3454b6a27b [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x5947ea3454b6a27b Time: 0.0108529 [04/18/2023-13:41:05] [V] [TRT] Fastest Tactic: 0x31de506085a332d4 Time: 0.00558892 [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0x31de506085a332d4 [04/18/2023-13:41:05] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Float(102400,400,20,1) *************** [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x733ba2a91a48d431 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x733ba2a91a48d431 Time: 0.009524 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0xf04572b287451f42 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xf04572b287451f42 Time: 0.0123352 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x5e4f6d7c83746fd6 Time: 0.00941257 [04/18/2023-13:41:05] [V] [TRT] Fastest Tactic: 0x5e4f6d7c83746fd6 Time: 0.00941257 [04/18/2023-13:41:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-13:41:05] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskJitConv) [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xc22b2f91e37e472a Time: 0.00614247 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x716fcb85e712b30e [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x716fcb85e712b30e Time: 0.0202234 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x5e4918ccf433630e [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x5e4918ccf433630e Time: 0.0121135 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xfac85bfa6e8a95c6 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xfac85bfa6e8a95c6 Time: 0.00851361 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0215458 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x2640501019a61dc2 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x2640501019a61dc2 Time: 0.00824483 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00613562 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xffb9fbd2bfa6c47d [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xffb9fbd2bfa6c47d Time: 0.00862091 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.00847973 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x31de506085a332d4 Time: 0.00524196 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x599d6bb582ecb830 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x599d6bb582ecb830 Time: 0.00724571 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00565574 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x601b41d38fc4645b [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x601b41d38fc4645b Time: 0.0111529 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x311b82feb19aef19 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x311b82feb19aef19 Time: 0.00570233 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xd9c6b8a2f7935fa5 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xd9c6b8a2f7935fa5 Time: 0.00789173 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x4f35593c356e2e7e Time: 0.0111585 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x596666386c88024b [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x596666386c88024b Time: 0.00540766 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0186509 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.011628 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x3ffcb62b1c6bb94f Time: 0.00710748 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcddae68de84cc6ee [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xcddae68de84cc6ee Time: 0.00548944 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00752938 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdfdddae7a4bcc830 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xdfdddae7a4bcc830 Time: 0.0185023 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xcae7b5888d47fe1f [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xcae7b5888d47fe1f Time: 0.00502558 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x7247cc5dea3981f1 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x7247cc5dea3981f1 Time: 0.0187794 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa5a7024b355e2bbc [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xa5a7024b355e2bbc Time: 0.00521224 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00594798 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.00814146 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x70ff342513dcddd5 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x70ff342513dcddd5 Time: 0.0184646 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00545084 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.0110766 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3912ca79eb9a8be1 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x3912ca79eb9a8be1 Time: 0.00532741 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5947ea3454b6a27b [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x5947ea3454b6a27b Time: 0.0114753 [04/18/2023-13:41:05] [V] [TRT] Fastest Tactic: 0xcae7b5888d47fe1f Time: 0.00502558 [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa71946688cad8664 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xa71946688cad8664 Time: 0.00764824 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x1e55f8b415964e81 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x1e55f8b415964e81 Time: 0.0134284 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.0112478 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9003f5f7ff9b1aec [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x9003f5f7ff9b1aec Time: 0.0205897 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9ec201b34455146e [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x9ec201b34455146e Time: 0.00724091 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x91930a570b557437 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x91930a570b557437 Time: 0.020446 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdf7e1bd6a496d667 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xdf7e1bd6a496d667 Time: 0.0133203 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6d377e4222886190 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x6d377e4222886190 Time: 0.00747703 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x271b998fe31732ef [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x271b998fe31732ef Time: 0.00945286 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.00809092 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x960e9baa2a6cad5b [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x960e9baa2a6cad5b Time: 0.00757798 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.00745691 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x84942841d92b0552 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x84942841d92b0552 Time: 0.0137425 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xbeb5d91e1874a437 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xbeb5d91e1874a437 Time: 0.0131786 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcd229658c16b33cd [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xcd229658c16b33cd Time: 0.0209117 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.00965699 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.00945457 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x33a5c6dd086942c1 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x33a5c6dd086942c1 Time: 0.007336 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7720f198395e7d3d [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x7720f198395e7d3d Time: 0.00927029 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0208575 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.0134171 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x60b880e28fee7a0c [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x60b880e28fee7a0c Time: 0.0208268 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcf64a2ae51bf6b36 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xcf64a2ae51bf6b36 Time: 0.00731291 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x844ea9c00f711f19 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x844ea9c00f711f19 Time: 0.00940714 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x65fbe45b4cb1d8a5 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x65fbe45b4cb1d8a5 Time: 0.00727268 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.0074768 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.00776662 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5bd8221bd57baf93 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x5bd8221bd57baf93 Time: 0.00763453 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0213002 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.00816737 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.0137563 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6e9c17a33c93d9b0 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x6e9c17a33c93d9b0 Time: 0.00924886 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.0143438 [04/18/2023-13:41:05] [V] [TRT] Fastest Tactic: 0x9ec201b34455146e Time: 0.00724091 [04/18/2023-13:41:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0xcae7b5888d47fe1f [04/18/2023-13:41:05] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskJitConv) [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xc22b2f91e37e472a Time: 0.0050437 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x716fcb85e712b30e [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x716fcb85e712b30e Time: 0.0141428 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x5e4918ccf433630e [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x5e4918ccf433630e Time: 0.00907114 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xfac85bfa6e8a95c6 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xfac85bfa6e8a95c6 Time: 0.00678795 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0152946 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x2640501019a61dc2 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x2640501019a61dc2 Time: 0.00636502 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00535365 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xffb9fbd2bfa6c47d [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xffb9fbd2bfa6c47d Time: 0.00677444 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.00690939 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x31de506085a332d4 Time: 0.00492252 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x599d6bb582ecb830 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x599d6bb582ecb830 Time: 0.00656125 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00544728 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x601b41d38fc4645b [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x601b41d38fc4645b Time: 0.00927886 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x311b82feb19aef19 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x311b82feb19aef19 Time: 0.0052258 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xd9c6b8a2f7935fa5 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xd9c6b8a2f7935fa5 Time: 0.00718469 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x4f35593c356e2e7e Time: 0.009402 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x596666386c88024b [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x596666386c88024b Time: 0.0049745 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0147433 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.00988739 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x3ffcb62b1c6bb94f Time: 0.00643498 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcddae68de84cc6ee [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xcddae68de84cc6ee Time: 0.00523575 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00662774 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdfdddae7a4bcc830 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xdfdddae7a4bcc830 Time: 0.014565 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xcae7b5888d47fe1f [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xcae7b5888d47fe1f Time: 0.00503582 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x7247cc5dea3981f1 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x7247cc5dea3981f1 Time: 0.0148649 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa5a7024b355e2bbc [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xa5a7024b355e2bbc Time: 0.00514139 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00569389 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.00742309 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x70ff342513dcddd5 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x70ff342513dcddd5 Time: 0.0145426 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00500698 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.009418 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3912ca79eb9a8be1 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x3912ca79eb9a8be1 Time: 0.00508958 [04/18/2023-13:41:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5947ea3454b6a27b [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x5947ea3454b6a27b Time: 0.00966461 [04/18/2023-13:41:05] [V] [TRT] Fastest Tactic: 0x31de506085a332d4 Time: 0.00492252 [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0x31de506085a332d4 [04/18/2023-13:41:05] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:05] [V] [TRT] *************** Autotuning format combination: Int8(102400,400,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:05] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:41:05] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:05] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.0039591 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00408025 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00419017 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00432228 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00453514 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00418194 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00438483 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00455586 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00521812 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00542578 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00528098 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00556607 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0112999 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00568756 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00611162 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00848134 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00422736 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00857035 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00831314 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00863247 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0115228 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00422171 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00408294 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00492815 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00625073 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0116825 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00629307 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00566699 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00957531 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0125029 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00529591 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00438885 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00541562 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00400914 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.012261 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0119535 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.009372 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00583296 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00476511 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00449957 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0119695 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.011693 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.009278 [04/18/2023-13:41:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:41:05] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00892971 [04/18/2023-13:41:05] [V] [TRT] Fastest Tactic: 0xeb1602207b0c3d49 Time: 0.0039591 [04/18/2023-13:41:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:41:05] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:05] [V] [TRT] *************** Autotuning format combination: Int8(51200,400,20,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: /model.39/Resize (Resize) [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00490834 [04/18/2023-13:41:05] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00490834 [04/18/2023-13:41:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000000 [04/18/2023-13:41:05] [V] [TRT] *************** Autotuning format combination: Int8(1600,400:32,20,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: /model.39/Resize (Resize) [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00295603 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00275077 [04/18/2023-13:41:05] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00314524 [04/18/2023-13:41:05] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.00275077 [04/18/2023-13:41:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000005 [04/18/2023-13:41:05] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:05] [V] [TRT] *************** Autotuning format combination: Int8(409600,1600,40,1) -> Int8(409600,1600,40,1) long-strided *************** [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] *************** Autotuning format combination: Int8(409600,1600,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(102400,1600:4,40,1) long-strided *************** [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:05] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(12800,1600:32,40,1) long-strided *************** [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:05] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Int8(12800,1600:32,40,1) long-strided *************** [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:41:05] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:05] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:05] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00500146 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00504812 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00533994 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00476907 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00489219 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00474396 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00454229 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.0048064 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.0052449 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00556343 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00545016 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00569055 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0112675 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00592475 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.0060739 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00855744 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00466345 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00829765 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.0082047 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.008352 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0116237 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00441198 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00460486 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00494976 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0063042 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0117756 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00631374 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00563974 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00968015 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0123394 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00531403 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00502841 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00562567 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00463867 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0120411 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0118994 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.009344 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00578706 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00478583 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00480762 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0119916 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0118259 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00933457 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00887449 [04/18/2023-13:41:06] [V] [TRT] Fastest Tactic: 0x0779fa4ac8f9f2ee Time: 0.00441198 [04/18/2023-13:41:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:41:06] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:41:06] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00496126 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00505742 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00520702 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00471889 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00486674 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00472406 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00455971 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00481661 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.0052542 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00557345 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00544322 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00569248 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0112538 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00576731 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00606114 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00852598 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00459414 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.0083421 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00811657 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00836952 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0116786 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00444398 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00461154 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00495433 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00630122 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0117254 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00636124 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00565521 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00961554 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0123634 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00531251 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00499594 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.0056058 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00464089 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.012117 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0119349 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00936629 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00580169 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00477303 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00480975 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0118731 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0117 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00931657 [04/18/2023-13:41:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00881345 [04/18/2023-13:41:06] [V] [TRT] Fastest Tactic: 0x0779fa4ac8f9f2ee Time: 0.00444398 [04/18/2023-13:41:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:41:06] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:06] [V] [TRT] *************** Autotuning format combination: Int8(409600,1600,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:41:06] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:06] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:4,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] *************** Autotuning format combination: Int8(3200,1600:32,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:41:06] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.00555253 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0058112 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00570549 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.00534502 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00548605 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.00539378 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00570919 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.00677569 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00692006 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00731886 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0110646 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.00690743 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.00704697 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0115232 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.017345 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00644134 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00775796 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0171723 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0178179 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00853889 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0075088 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0132031 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0177199 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.00541393 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00580425 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.017822 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0176508 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0126 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00788499 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00601543 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00576037 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0122221 [04/18/2023-13:41:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0116174 [04/18/2023-13:41:06] [V] [TRT] Fastest Tactic: 0x83caf00de690c0ec Time: 0.00534502 [04/18/2023-13:41:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x83caf00de690c0ec [04/18/2023-13:41:06] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:06] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600,40,1) -> Int8(409600,1600,40,1) long-strided *************** [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:4,40,1) -> Int8(102400,1600:4,40,1) long-strided *************** [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:4,40,1) -> Int8(12800,1600:32,40,1) long-strided *************** [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:4,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] *************** Autotuning format combination: Int8(3200,1600:32,40,1) -> Int8(12800,1600:32,40,1) long-strided *************** [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:41:06] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.00553143 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00579822 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00573861 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.00533452 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.0054891 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.00541325 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00570128 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.00675387 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00694008 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00727589 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0110745 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.00697012 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.00706743 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0113276 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0173613 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00641868 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00774881 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0171931 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0177178 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00862306 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00759386 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.013098 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0177666 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.00533503 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00577957 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0176782 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0176208 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0126263 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00771489 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00600514 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00577774 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0122057 [04/18/2023-13:41:06] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0115981 [04/18/2023-13:41:06] [V] [TRT] Fastest Tactic: 0x83caf00de690c0ec Time: 0.00533452 [04/18/2023-13:41:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x83caf00de690c0ec [04/18/2023-13:41:06] [V] [TRT] *************** Autotuning format combination: Int8(3200,1600:32,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:41:06] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:06] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Float(409600,1600,40,1) long-strided *************** [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:06] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 0xc25454de2efcccdc [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xc25454de2efcccdc Time: 0.0142691 [04/18/2023-13:41:06] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: 0xff6944b17d5b2e32 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xff6944b17d5b2e32 Time: 0.014453 [04/18/2023-13:41:06] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0192469 [04/18/2023-13:41:06] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.0151351 [04/18/2023-13:41:06] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.0160747 [04/18/2023-13:41:06] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0151319 [04/18/2023-13:41:06] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.0192 [04/18/2023-13:41:06] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0144357 [04/18/2023-13:41:06] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 0x1db6e8cf1382fbe0 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x1db6e8cf1382fbe0 Time: 0.0190171 [04/18/2023-13:41:06] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: 0xa4ae2d82115c3e83 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xa4ae2d82115c3e83 Time: 0.0156311 [04/18/2023-13:41:06] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.014965 [04/18/2023-13:41:06] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0164556 [04/18/2023-13:41:06] [V] [TRT] Fastest Tactic: 0xc25454de2efcccdc Time: 0.0142691 [04/18/2023-13:41:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xc25454de2efcccdc [04/18/2023-13:41:06] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Float(204800,1600,40,1) *************** [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:06] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:06] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 0xc25454de2efcccdc [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xc25454de2efcccdc Time: 0.0140567 [04/18/2023-13:41:06] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: 0xff6944b17d5b2e32 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xff6944b17d5b2e32 Time: 0.0142255 [04/18/2023-13:41:06] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.018992 [04/18/2023-13:41:06] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.0150295 [04/18/2023-13:41:06] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.0158144 [04/18/2023-13:41:06] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-13:41:06] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0149541 [04/18/2023-13:41:06] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.0191091 [04/18/2023-13:41:06] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-13:41:06] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0141976 [04/18/2023-13:41:06] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 0x1db6e8cf1382fbe0 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x1db6e8cf1382fbe0 Time: 0.0188463 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: 0xa4ae2d82115c3e83 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xa4ae2d82115c3e83 Time: 0.0154642 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.0147662 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0162885 [04/18/2023-13:41:07] [V] [TRT] Fastest Tactic: 0xc25454de2efcccdc Time: 0.0140567 [04/18/2023-13:41:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xc25454de2efcccdc [04/18/2023-13:41:07] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Float(409600,1600,40,1) long-strided *************** [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x733ba2a91a48d431 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x733ba2a91a48d431 Time: 0.00881694 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0xf04572b287451f42 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xf04572b287451f42 Time: 0.010526 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x5e4f6d7c83746fd6 Time: 0.00909514 [04/18/2023-13:41:07] [V] [TRT] Fastest Tactic: 0x733ba2a91a48d431 Time: 0.00881694 [04/18/2023-13:41:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x733ba2a91a48d431 [04/18/2023-13:41:07] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Float(12800,1600:32,40,1) long-strided *************** [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskJitConv) [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xc22b2f91e37e472a Time: 0.00569389 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x716fcb85e712b30e [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x716fcb85e712b30e Time: 0.0108046 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x5e4918ccf433630e [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x5e4918ccf433630e Time: 0.00888121 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xfac85bfa6e8a95c6 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xfac85bfa6e8a95c6 Time: 0.00652093 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.015008 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x2640501019a61dc2 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x2640501019a61dc2 Time: 0.00636243 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.0058624 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xffb9fbd2bfa6c47d [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xffb9fbd2bfa6c47d Time: 0.00683842 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.00652571 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x31de506085a332d4 Time: 0.00613638 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x599d6bb582ecb830 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x599d6bb582ecb830 Time: 0.00656374 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00629287 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x601b41d38fc4645b [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x601b41d38fc4645b Time: 0.00920229 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x311b82feb19aef19 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x311b82feb19aef19 Time: 0.00596705 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xd9c6b8a2f7935fa5 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xd9c6b8a2f7935fa5 Time: 0.00693638 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x4f35593c356e2e7e Time: 0.00918486 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x596666386c88024b [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x596666386c88024b Time: 0.00624596 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0113224 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.00957653 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x3ffcb62b1c6bb94f Time: 0.00638708 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcddae68de84cc6ee [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xcddae68de84cc6ee Time: 0.00613029 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00656873 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdfdddae7a4bcc830 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xdfdddae7a4bcc830 Time: 0.0112897 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xcae7b5888d47fe1f [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xcae7b5888d47fe1f Time: 0.00578414 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x7247cc5dea3981f1 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x7247cc5dea3981f1 Time: 0.0144768 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa5a7024b355e2bbc [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xa5a7024b355e2bbc Time: 0.00577975 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00596172 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.00710509 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x70ff342513dcddd5 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x70ff342513dcddd5 Time: 0.0141731 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00657953 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.00894343 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3912ca79eb9a8be1 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x3912ca79eb9a8be1 Time: 0.00607448 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5947ea3454b6a27b [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x5947ea3454b6a27b Time: 0.00950057 [04/18/2023-13:41:07] [V] [TRT] Fastest Tactic: 0xc22b2f91e37e472a Time: 0.00569389 [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa71946688cad8664 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xa71946688cad8664 Time: 0.00827632 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x1e55f8b415964e81 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x1e55f8b415964e81 Time: 0.0117173 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.00987276 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9003f5f7ff9b1aec [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x9003f5f7ff9b1aec Time: 0.0168279 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9ec201b34455146e [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x9ec201b34455146e Time: 0.00842084 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x91930a570b557437 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x91930a570b557437 Time: 0.0133856 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdf7e1bd6a496d667 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xdf7e1bd6a496d667 Time: 0.0115945 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6d377e4222886190 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x6d377e4222886190 Time: 0.00854642 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x271b998fe31732ef [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x271b998fe31732ef Time: 0.00880968 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.00923028 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x960e9baa2a6cad5b [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x960e9baa2a6cad5b Time: 0.00813943 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.00888471 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x84942841d92b0552 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x84942841d92b0552 Time: 0.012019 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xbeb5d91e1874a437 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xbeb5d91e1874a437 Time: 0.0113994 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcd229658c16b33cd [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xcd229658c16b33cd Time: 0.0169879 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.00889842 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.009078 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x33a5c6dd086942c1 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x33a5c6dd086942c1 Time: 0.00854292 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7720f198395e7d3d [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x7720f198395e7d3d Time: 0.00864323 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0138917 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.0114229 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x60b880e28fee7a0c [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x60b880e28fee7a0c Time: 0.0137816 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcf64a2ae51bf6b36 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xcf64a2ae51bf6b36 Time: 0.00884007 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x844ea9c00f711f19 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x844ea9c00f711f19 Time: 0.00883039 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x65fbe45b4cb1d8a5 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x65fbe45b4cb1d8a5 Time: 0.00878575 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.00864645 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.00883872 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5bd8221bd57baf93 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x5bd8221bd57baf93 Time: 0.00867281 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0173577 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.00859859 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.0120171 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6e9c17a33c93d9b0 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x6e9c17a33c93d9b0 Time: 0.00871529 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.0121851 [04/18/2023-13:41:07] [V] [TRT] Fastest Tactic: 0x960e9baa2a6cad5b Time: 0.00813943 [04/18/2023-13:41:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0xc22b2f91e37e472a [04/18/2023-13:41:07] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Half(12800,1600:32,40,1) long-strided *************** [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskJitConv) [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xc22b2f91e37e472a Time: 0.00480366 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x716fcb85e712b30e [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x716fcb85e712b30e Time: 0.00941429 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x5e4918ccf433630e [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x5e4918ccf433630e Time: 0.0071664 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xfac85bfa6e8a95c6 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xfac85bfa6e8a95c6 Time: 0.00583918 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0111458 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x2640501019a61dc2 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x2640501019a61dc2 Time: 0.00546641 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00541579 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xffb9fbd2bfa6c47d [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xffb9fbd2bfa6c47d Time: 0.00589477 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.00570796 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x31de506085a332d4 Time: 0.0054058 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x599d6bb582ecb830 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x599d6bb582ecb830 Time: 0.00587538 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00591836 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x601b41d38fc4645b [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x601b41d38fc4645b Time: 0.00737828 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x311b82feb19aef19 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x311b82feb19aef19 Time: 0.00507066 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xd9c6b8a2f7935fa5 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xd9c6b8a2f7935fa5 Time: 0.00622032 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x4f35593c356e2e7e Time: 0.00739451 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x596666386c88024b [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x596666386c88024b Time: 0.00549679 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.00988678 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.00781666 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x3ffcb62b1c6bb94f Time: 0.00570391 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcddae68de84cc6ee [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xcddae68de84cc6ee Time: 0.00583186 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00570497 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdfdddae7a4bcc830 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xdfdddae7a4bcc830 Time: 0.0104015 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xcae7b5888d47fe1f [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xcae7b5888d47fe1f Time: 0.00550242 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x7247cc5dea3981f1 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x7247cc5dea3981f1 Time: 0.010638 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa5a7024b355e2bbc [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xa5a7024b355e2bbc Time: 0.0052222 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00545964 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.0063523 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x70ff342513dcddd5 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x70ff342513dcddd5 Time: 0.0102567 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00584338 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.0073248 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3912ca79eb9a8be1 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x3912ca79eb9a8be1 Time: 0.00563938 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5947ea3454b6a27b [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x5947ea3454b6a27b Time: 0.00767471 [04/18/2023-13:41:07] [V] [TRT] Fastest Tactic: 0xc22b2f91e37e472a Time: 0.00480366 [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0xc22b2f91e37e472a [04/18/2023-13:41:07] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Float(204800,1600,40,1) *************** [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x733ba2a91a48d431 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x733ba2a91a48d431 Time: 0.00865237 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0xf04572b287451f42 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xf04572b287451f42 Time: 0.0103131 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x5e4f6d7c83746fd6 Time: 0.00892914 [04/18/2023-13:41:07] [V] [TRT] Fastest Tactic: 0x733ba2a91a48d431 Time: 0.00865237 [04/18/2023-13:41:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x733ba2a91a48d431 [04/18/2023-13:41:07] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Float(6400,1600:32,40,1) *************** [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskJitConv) [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xc22b2f91e37e472a Time: 0.00573367 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x716fcb85e712b30e [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x716fcb85e712b30e Time: 0.010817 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x5e4918ccf433630e [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x5e4918ccf433630e Time: 0.00886776 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xfac85bfa6e8a95c6 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xfac85bfa6e8a95c6 Time: 0.00655751 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0150203 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x2640501019a61dc2 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x2640501019a61dc2 Time: 0.00654483 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00587228 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xffb9fbd2bfa6c47d [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xffb9fbd2bfa6c47d Time: 0.00681208 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.00659678 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x31de506085a332d4 Time: 0.0060979 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x599d6bb582ecb830 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x599d6bb582ecb830 Time: 0.00653569 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00632268 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x601b41d38fc4645b [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x601b41d38fc4645b Time: 0.00918029 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x311b82feb19aef19 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x311b82feb19aef19 Time: 0.00597448 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xd9c6b8a2f7935fa5 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xd9c6b8a2f7935fa5 Time: 0.00699037 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x4f35593c356e2e7e Time: 0.00913629 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x596666386c88024b [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x596666386c88024b Time: 0.00623046 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0113248 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.00955764 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x3ffcb62b1c6bb94f Time: 0.00634037 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcddae68de84cc6ee [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xcddae68de84cc6ee Time: 0.00627895 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00657018 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdfdddae7a4bcc830 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xdfdddae7a4bcc830 Time: 0.0113097 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xcae7b5888d47fe1f [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xcae7b5888d47fe1f Time: 0.00576805 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x7247cc5dea3981f1 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x7247cc5dea3981f1 Time: 0.0145115 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa5a7024b355e2bbc [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xa5a7024b355e2bbc Time: 0.00583132 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.005992 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.00722492 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x70ff342513dcddd5 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x70ff342513dcddd5 Time: 0.0141789 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00667096 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.00893514 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3912ca79eb9a8be1 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x3912ca79eb9a8be1 Time: 0.00608133 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5947ea3454b6a27b [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x5947ea3454b6a27b Time: 0.00947086 [04/18/2023-13:41:07] [V] [TRT] Fastest Tactic: 0xc22b2f91e37e472a Time: 0.00573367 [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa71946688cad8664 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xa71946688cad8664 Time: 0.00850474 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x1e55f8b415964e81 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x1e55f8b415964e81 Time: 0.0117419 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.0098432 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9003f5f7ff9b1aec [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x9003f5f7ff9b1aec Time: 0.0168345 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9ec201b34455146e [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x9ec201b34455146e Time: 0.00844477 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x91930a570b557437 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x91930a570b557437 Time: 0.0133785 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdf7e1bd6a496d667 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xdf7e1bd6a496d667 Time: 0.01159 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6d377e4222886190 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x6d377e4222886190 Time: 0.00850286 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x271b998fe31732ef [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x271b998fe31732ef Time: 0.00876639 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.00869539 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x960e9baa2a6cad5b [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x960e9baa2a6cad5b Time: 0.00810286 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.00891375 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x84942841d92b0552 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x84942841d92b0552 Time: 0.012096 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xbeb5d91e1874a437 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xbeb5d91e1874a437 Time: 0.01138 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcd229658c16b33cd [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xcd229658c16b33cd Time: 0.0169204 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.00898314 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.00905086 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x33a5c6dd086942c1 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x33a5c6dd086942c1 Time: 0.00848726 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7720f198395e7d3d [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x7720f198395e7d3d Time: 0.00860155 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0140268 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.0114222 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x60b880e28fee7a0c [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x60b880e28fee7a0c Time: 0.0138174 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcf64a2ae51bf6b36 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xcf64a2ae51bf6b36 Time: 0.00878521 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x844ea9c00f711f19 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x844ea9c00f711f19 Time: 0.00878709 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x65fbe45b4cb1d8a5 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x65fbe45b4cb1d8a5 Time: 0.00875913 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.00860639 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.00866743 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5bd8221bd57baf93 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x5bd8221bd57baf93 Time: 0.00867523 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0173491 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.00859348 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.0120038 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6e9c17a33c93d9b0 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x6e9c17a33c93d9b0 Time: 0.00866151 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.012131 [04/18/2023-13:41:07] [V] [TRT] Fastest Tactic: 0x960e9baa2a6cad5b Time: 0.00810286 [04/18/2023-13:41:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0xc22b2f91e37e472a [04/18/2023-13:41:07] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Half(6400,1600:32,40,1) *************** [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskJitConv) [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xc22b2f91e37e472a Time: 0.00479802 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x716fcb85e712b30e [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x716fcb85e712b30e Time: 0.00940829 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x5e4918ccf433630e [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x5e4918ccf433630e Time: 0.00712621 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xfac85bfa6e8a95c6 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xfac85bfa6e8a95c6 Time: 0.00581303 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0111349 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x2640501019a61dc2 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x2640501019a61dc2 Time: 0.0054808 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00539632 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xffb9fbd2bfa6c47d [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xffb9fbd2bfa6c47d Time: 0.00591214 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.00570848 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x31de506085a332d4 Time: 0.0053843 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x599d6bb582ecb830 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x599d6bb582ecb830 Time: 0.00585362 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00586898 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x601b41d38fc4645b [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x601b41d38fc4645b Time: 0.00736251 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x311b82feb19aef19 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x311b82feb19aef19 Time: 0.00505174 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xd9c6b8a2f7935fa5 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xd9c6b8a2f7935fa5 Time: 0.00622589 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x4f35593c356e2e7e Time: 0.0073696 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x596666386c88024b [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x596666386c88024b Time: 0.00548385 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0098752 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0077683 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x3ffcb62b1c6bb94f Time: 0.00569899 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcddae68de84cc6ee [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xcddae68de84cc6ee Time: 0.00582546 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00570602 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdfdddae7a4bcc830 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xdfdddae7a4bcc830 Time: 0.00989836 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xcae7b5888d47fe1f [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xcae7b5888d47fe1f Time: 0.00518155 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x7247cc5dea3981f1 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x7247cc5dea3981f1 Time: 0.0106015 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa5a7024b355e2bbc [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xa5a7024b355e2bbc Time: 0.00523233 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00544677 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.00639722 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x70ff342513dcddd5 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x70ff342513dcddd5 Time: 0.0102704 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00577774 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.00732503 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3912ca79eb9a8be1 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x3912ca79eb9a8be1 Time: 0.00565925 [04/18/2023-13:41:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5947ea3454b6a27b [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x5947ea3454b6a27b Time: 0.00766508 [04/18/2023-13:41:07] [V] [TRT] Fastest Tactic: 0xc22b2f91e37e472a Time: 0.00479802 [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0xc22b2f91e37e472a [04/18/2023-13:41:07] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:07] [V] [TRT] *************** Autotuning format combination: Int8(204800,1600,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:07] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:41:07] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:07] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00447058 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00424484 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00442667 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00428249 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00444024 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00430198 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00418024 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00433011 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00455657 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00487299 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00483322 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00503488 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.00906543 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00498948 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00530167 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00754262 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00411585 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00723154 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00705546 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00732503 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.00938486 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00406603 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00399975 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00469338 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00548673 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.00945514 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00534485 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00474293 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00818311 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.00995078 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00469147 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00428894 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00490469 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00409665 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.00978834 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.00951371 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00795936 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00491033 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00423368 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00420544 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.00967131 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.00940914 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00811759 [04/18/2023-13:41:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:41:07] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.007776 [04/18/2023-13:41:07] [V] [TRT] Fastest Tactic: 0x4862d9a1cd4ec818 Time: 0.00399975 [04/18/2023-13:41:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:41:07] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:07] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600,40,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: /model.49/Resize (Resize) [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00727749 [04/18/2023-13:41:07] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00727749 [04/18/2023-13:41:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000000 [04/18/2023-13:41:07] [V] [TRT] *************** Autotuning format combination: Int8(3200,1600:32,40,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: /model.49/Resize (Resize) [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00329392 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00305663 [04/18/2023-13:41:07] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00342748 [04/18/2023-13:41:07] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.00305663 [04/18/2023-13:41:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000005 [04/18/2023-13:41:07] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:07] [V] [TRT] *************** Autotuning format combination: Int8(819200,6400,80,1) -> Int8(819200,6400,80,1) long-strided *************** [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] *************** Autotuning format combination: Int8(819200,6400,80,1) -> Int8(204800,6400,80,1) *************** [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Int8(204800,6400:4,80,1) long-strided *************** [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:07] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Int8(25600,6400:32,80,1) long-strided *************** [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Int8(51200,6400:4,80,1) *************** [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:07] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] *************** Autotuning format combination: Int8(25600,6400:32,80,1) -> Int8(25600,6400:32,80,1) long-strided *************** [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:41:07] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:07] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:07] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00600952 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00598686 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00601105 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00514302 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00527331 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00676052 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00556624 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00570004 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00697034 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00748594 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00515788 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00554426 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0106945 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00512571 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00543187 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00738857 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00498365 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00810489 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00782292 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00827327 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0108039 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00529151 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00584338 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00524686 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00561459 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.010943 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00549679 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00733874 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00791844 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0100913 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00710487 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00576018 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.0054229 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00606952 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0098688 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0109029 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00873008 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00540072 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.0054989 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0068221 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.00986941 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.00958659 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00805359 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00769588 [04/18/2023-13:41:08] [V] [TRT] Fastest Tactic: 0xa40d21cb7ebb07bf Time: 0.00498365 [04/18/2023-13:41:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:41:08] [V] [TRT] *************** Autotuning format combination: Int8(25600,6400:32,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:41:08] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00582455 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.005968 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00601924 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00515037 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00527608 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00673662 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00558259 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00567877 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00702476 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00747314 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00545829 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00556325 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0106789 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.0051053 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00544982 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.0073728 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00501896 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00804495 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00783134 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00812318 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0107889 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00530421 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00583351 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00521829 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00563763 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0109322 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00549215 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00734834 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00792421 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0100687 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00709921 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00578706 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00542798 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00611886 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.009856 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0108761 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00870023 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0053716 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00552861 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00684016 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.00985722 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.00950886 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0080546 [04/18/2023-13:41:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00765329 [04/18/2023-13:41:08] [V] [TRT] Fastest Tactic: 0xa40d21cb7ebb07bf Time: 0.00501896 [04/18/2023-13:41:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:41:08] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:08] [V] [TRT] *************** Autotuning format combination: Int8(819200,6400,80,1) -> Int8(204800,6400,80,1) *************** [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Int8(51200,6400:4,80,1) *************** [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] *************** Autotuning format combination: Int8(25600,6400:32,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-13:41:08] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:08] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400,80,1) -> Int8(204800,6400,80,1) *************** [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] *************** Autotuning format combination: Int8(51200,6400:4,80,1) -> Int8(51200,6400:4,80,1) *************** [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] *************** Autotuning format combination: Int8(51200,6400:4,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] *************** Autotuning format combination: Int8(6400,6400:32,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:41:08] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.00652364 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00672 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00593335 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.00789005 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.0081826 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.0062724 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00670566 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.009 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00932657 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0062873 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.00951429 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.00607105 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.00600762 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00979352 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0131001 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00586149 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00658493 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0139915 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0142921 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00694835 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0100477 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0102456 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0135904 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.00565116 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00719497 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0131765 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0143895 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.010606 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00647573 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00647115 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00889089 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00979687 [04/18/2023-13:41:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.00921543 [04/18/2023-13:41:08] [V] [TRT] Fastest Tactic: 0x5e921a04a7b0e583 Time: 0.00565116 [04/18/2023-13:41:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5e921a04a7b0e583 [04/18/2023-13:41:08] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:08] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400,80,1) -> Int8(819200,6400,80,1) long-strided *************** [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400,80,1) -> Int8(204800,6400,80,1) *************** [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] *************** Autotuning format combination: Int8(51200,6400:4,80,1) -> Int8(204800,6400:4,80,1) long-strided *************** [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] *************** Autotuning format combination: Int8(51200,6400:4,80,1) -> Int8(25600,6400:32,80,1) long-strided *************** [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] *************** Autotuning format combination: Int8(51200,6400:4,80,1) -> Int8(51200,6400:4,80,1) *************** [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] *************** Autotuning format combination: Int8(51200,6400:4,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] *************** Autotuning format combination: Int8(6400,6400:32,80,1) -> Int8(25600,6400:32,80,1) long-strided *************** [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:41:08] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.00663231 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00672893 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00593024 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.00789799 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00816432 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.00629446 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00672145 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.009042 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.009334 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00628512 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.00950714 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.00642763 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.00601638 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00983375 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0131133 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0059581 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0065974 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0139649 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0144325 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0068948 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0100599 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0102465 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0134803 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.00557134 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00722469 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.013179 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0144 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.010593 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00650597 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00642147 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00895857 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00977829 [04/18/2023-13:41:08] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.00919286 [04/18/2023-13:41:08] [V] [TRT] Fastest Tactic: 0x5e921a04a7b0e583 Time: 0.00557134 [04/18/2023-13:41:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5e921a04a7b0e583 [04/18/2023-13:41:08] [V] [TRT] *************** Autotuning format combination: Int8(6400,6400:32,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-13:41:08] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:08] [V] [TRT] *************** Autotuning format combination: Int8(819200,6400,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] *************** Autotuning format combination: Int8(25600,6400:32,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-13:41:08] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:08] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Float(409600,1600,40,1) long-strided *************** [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:08] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 Tactic: 0x127de12a1f1a4809 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x127de12a1f1a4809 Time: 0.0309248 [04/18/2023-13:41:08] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0303104 [04/18/2023-13:41:08] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.0227331 [04/18/2023-13:41:08] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.0243322 [04/18/2023-13:41:08] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0229878 [04/18/2023-13:41:08] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.0304567 [04/18/2023-13:41:08] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0207269 [04/18/2023-13:41:08] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 Tactic: 0x1b0534177b414e71 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x1b0534177b414e71 Time: 0.0219272 [04/18/2023-13:41:08] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.0215458 [04/18/2023-13:41:08] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0256488 [04/18/2023-13:41:08] [V] [TRT] Fastest Tactic: 0x4d9d0d03129bceb1 Time: 0.0207269 [04/18/2023-13:41:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4d9d0d03129bceb1 [04/18/2023-13:41:08] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Float(204800,1600,40,1) *************** [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:08] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 Tactic: 0x127de12a1f1a4809 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x127de12a1f1a4809 Time: 0.0307045 [04/18/2023-13:41:08] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0300453 [04/18/2023-13:41:08] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.022558 [04/18/2023-13:41:08] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.0241691 [04/18/2023-13:41:08] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0228349 [04/18/2023-13:41:08] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.0302738 [04/18/2023-13:41:08] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0205329 [04/18/2023-13:41:08] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 Tactic: 0x1b0534177b414e71 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x1b0534177b414e71 Time: 0.0216503 [04/18/2023-13:41:08] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.0213277 [04/18/2023-13:41:08] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0254964 [04/18/2023-13:41:08] [V] [TRT] Fastest Tactic: 0x4d9d0d03129bceb1 Time: 0.0205329 [04/18/2023-13:41:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4d9d0d03129bceb1 [04/18/2023-13:41:08] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Float(409600,1600,40,1) long-strided *************** [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:08] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:08] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x2bcbba39f608bf10 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x2bcbba39f608bf10 Time: 0.0116561 [04/18/2023-13:41:08] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x85c1a5f7f239cf84 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x85c1a5f7f239cf84 Time: 0.0100017 [04/18/2023-13:41:08] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0xac914b235d066808 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xac914b235d066808 Time: 0.015872 [04/18/2023-13:41:08] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0xa8b56a226b057463 [04/18/2023-13:41:08] [V] [TRT] Tactic: 0xa8b56a226b057463 Time: 0.00996236 [04/18/2023-13:41:08] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x64x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x23b890da05937b9e [04/18/2023-13:41:08] [V] [TRT] Tactic: 0x23b890da05937b9e Time: 0.0111705 [04/18/2023-13:41:08] [V] [TRT] Fastest Tactic: 0xa8b56a226b057463 Time: 0.00996236 [04/18/2023-13:41:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa8b56a226b057463 [04/18/2023-13:41:08] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Float(12800,1600:32,40,1) long-strided *************** [04/18/2023-13:41:18] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskJitConv) [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3d41ef6de22d9b6 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0xd3d41ef6de22d9b6 Time: 0.0136756 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0230067 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00798121 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.00926857 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xf8d4389f60adfa3c [04/18/2023-13:41:18] [V] [TRT] Tactic: 0xf8d4389f60adfa3c Time: 0.0227722 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00884544 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2f34f689bfca5071 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x2f34f689bfca5071 Time: 0.00756379 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x554e2e252e28b3fd [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x554e2e252e28b3fd Time: 0.018888 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0193474 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x4749124f62d8bd23 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x4749124f62d8bd23 Time: 0.00879489 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3f592fae61c7986 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0xd3f592fae61c7986 Time: 0.00857035 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0138664 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00906486 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xbb88763c3b0e94d4 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0xbb88763c3b0e94d4 Time: 0.00778803 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea88b51105501f96 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0xea88b51105501f96 Time: 0.0136141 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd30e9f770878c3fd [04/18/2023-13:41:18] [V] [TRT] Tactic: 0xd30e9f770878c3fd Time: 0.00884867 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x53554c607d072468 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x53554c607d072468 Time: 0.00938657 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00785444 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.00968929 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00873277 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.0132455 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x705baf38e41eee0b [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x705baf38e41eee0b Time: 0.00873331 [04/18/2023-13:41:18] [V] [TRT] Fastest Tactic: 0x2f34f689bfca5071 Time: 0.00756379 [04/18/2023-13:41:18] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:18] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:18] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x45f7566cdb2b10fb [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x45f7566cdb2b10fb Time: 0.011321 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-13:41:18] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.0142201 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea2b7420057a01c1 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0xea2b7420057a01c1 Time: 0.0217966 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.0113424 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2d8ab2aa0639fda9 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x2d8ab2aa0639fda9 Time: 0.0104888 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd14bd6d95fefd45e [04/18/2023-13:41:18] [V] [TRT] Tactic: 0xd14bd6d95fefd45e Time: 0.0112865 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.0117799 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.0117553 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.0117489 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x0e07dc8353bf7e9f [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x0e07dc8353bf7e9f Time: 0.0162103 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x55edef142e02adaa [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x55edef142e02adaa Time: 0.0156955 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0220264 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.0164003 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x0edd5d0285e564d4 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x0edd5d0285e564d4 Time: 0.0114852 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xb936321f82fd390c [04/18/2023-13:41:18] [V] [TRT] Tactic: 0xb936321f82fd390c Time: 0.010798 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.0108705 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.0115879 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xad886d4d69834922 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0xad886d4d69834922 Time: 0.0114447 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0258918 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x47b1629a4bff4800 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x47b1629a4bff4800 Time: 0.0254065 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.0109264 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.0168264 [04/18/2023-13:41:18] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-13:41:18] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.0179743 [04/18/2023-13:41:18] [V] [TRT] Fastest Tactic: 0x2d8ab2aa0639fda9 Time: 0.0104888 [04/18/2023-13:41:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0x2f34f689bfca5071 [04/18/2023-13:41:18] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Half(12800,1600:32,40,1) long-strided *************** [04/18/2023-13:41:28] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskJitConv) [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3d41ef6de22d9b6 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xd3d41ef6de22d9b6 Time: 0.0117141 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0186137 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00743406 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.00827835 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xf8d4389f60adfa3c [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xf8d4389f60adfa3c Time: 0.0183771 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00830578 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2f34f689bfca5071 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x2f34f689bfca5071 Time: 0.00717372 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x554e2e252e28b3fd [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x554e2e252e28b3fd Time: 0.0172678 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0175213 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x4749124f62d8bd23 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x4749124f62d8bd23 Time: 0.00824102 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3f592fae61c7986 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xd3f592fae61c7986 Time: 0.00761456 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0118393 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00810489 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xbb88763c3b0e94d4 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xbb88763c3b0e94d4 Time: 0.00680249 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea88b51105501f96 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xea88b51105501f96 Time: 0.0113846 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd30e9f770878c3fd [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xd30e9f770878c3fd Time: 0.0079934 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x53554c607d072468 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x53554c607d072468 Time: 0.00853889 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00718972 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.00887126 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00781281 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.0113695 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x705baf38e41eee0b [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x705baf38e41eee0b Time: 0.00795352 [04/18/2023-13:41:28] [V] [TRT] Fastest Tactic: 0xbb88763c3b0e94d4 Time: 0.00680249 [04/18/2023-13:41:28] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:28] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:28] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0xbb88763c3b0e94d4 [04/18/2023-13:41:28] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Float(204800,1600,40,1) *************** [04/18/2023-13:41:28] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:28] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:28] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x2bcbba39f608bf10 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x2bcbba39f608bf10 Time: 0.0130265 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x85c1a5f7f239cf84 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x85c1a5f7f239cf84 Time: 0.01113 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0xac914b235d066808 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xac914b235d066808 Time: 0.0179789 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0xa8b56a226b057463 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xa8b56a226b057463 Time: 0.011084 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x64x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x23b890da05937b9e [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x23b890da05937b9e Time: 0.012416 [04/18/2023-13:41:28] [V] [TRT] Fastest Tactic: 0xa8b56a226b057463 Time: 0.011084 [04/18/2023-13:41:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa8b56a226b057463 [04/18/2023-13:41:28] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Float(6400,1600:32,40,1) *************** [04/18/2023-13:41:28] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskJitConv) [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3d41ef6de22d9b6 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xd3d41ef6de22d9b6 Time: 0.0135967 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0229871 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00775988 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.00927429 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xf8d4389f60adfa3c [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xf8d4389f60adfa3c Time: 0.0226932 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.0088441 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2f34f689bfca5071 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x2f34f689bfca5071 Time: 0.00756836 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x554e2e252e28b3fd [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x554e2e252e28b3fd Time: 0.0188371 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.019152 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x4749124f62d8bd23 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x4749124f62d8bd23 Time: 0.00867442 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3f592fae61c7986 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xd3f592fae61c7986 Time: 0.00853002 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0138581 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00908657 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xbb88763c3b0e94d4 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xbb88763c3b0e94d4 Time: 0.00775314 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea88b51105501f96 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xea88b51105501f96 Time: 0.0133785 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd30e9f770878c3fd [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xd30e9f770878c3fd Time: 0.0087844 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x53554c607d072468 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x53554c607d072468 Time: 0.00937114 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00784048 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.00967497 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00872793 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.0132484 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x705baf38e41eee0b [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x705baf38e41eee0b Time: 0.00875429 [04/18/2023-13:41:28] [V] [TRT] Fastest Tactic: 0x2f34f689bfca5071 Time: 0.00756836 [04/18/2023-13:41:28] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:28] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:28] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x45f7566cdb2b10fb [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x45f7566cdb2b10fb Time: 0.0112939 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.0141631 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea2b7420057a01c1 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xea2b7420057a01c1 Time: 0.0217959 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.0113034 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2d8ab2aa0639fda9 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x2d8ab2aa0639fda9 Time: 0.0104046 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd14bd6d95fefd45e [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xd14bd6d95fefd45e Time: 0.011244 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.0117753 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.011712 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.0117704 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x0e07dc8353bf7e9f [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x0e07dc8353bf7e9f Time: 0.0161783 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x55edef142e02adaa [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x55edef142e02adaa Time: 0.0156494 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0220264 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.0160574 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x0edd5d0285e564d4 [04/18/2023-13:41:28] [V] [TRT] Tactic: 0x0edd5d0285e564d4 Time: 0.0114817 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xb936321f82fd390c [04/18/2023-13:41:28] [V] [TRT] Tactic: 0xb936321f82fd390c Time: 0.0107572 [04/18/2023-13:41:28] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.0108173 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.0114483 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xad886d4d69834922 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xad886d4d69834922 Time: 0.0113558 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0258682 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x47b1629a4bff4800 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x47b1629a4bff4800 Time: 0.025453 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.0108637 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.016514 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.017599 [04/18/2023-13:41:29] [V] [TRT] Fastest Tactic: 0x2d8ab2aa0639fda9 Time: 0.0104046 [04/18/2023-13:41:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0x2f34f689bfca5071 [04/18/2023-13:41:29] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Half(6400,1600:32,40,1) *************** [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskJitConv) [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3d41ef6de22d9b6 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xd3d41ef6de22d9b6 Time: 0.0115552 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0186143 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00732708 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.0082847 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xf8d4389f60adfa3c [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xf8d4389f60adfa3c Time: 0.0183646 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00831391 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2f34f689bfca5071 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x2f34f689bfca5071 Time: 0.0071808 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x554e2e252e28b3fd [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x554e2e252e28b3fd Time: 0.0165892 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0155433 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x4749124f62d8bd23 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x4749124f62d8bd23 Time: 0.00723291 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3f592fae61c7986 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xd3f592fae61c7986 Time: 0.00675055 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0105851 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00723589 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xbb88763c3b0e94d4 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xbb88763c3b0e94d4 Time: 0.00597905 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea88b51105501f96 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xea88b51105501f96 Time: 0.0101583 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd30e9f770878c3fd [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xd30e9f770878c3fd Time: 0.00709725 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x53554c607d072468 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x53554c607d072468 Time: 0.00758953 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00637356 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.00787008 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00691744 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.0101355 [04/18/2023-13:41:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x705baf38e41eee0b [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x705baf38e41eee0b Time: 0.00710944 [04/18/2023-13:41:29] [V] [TRT] Fastest Tactic: 0xbb88763c3b0e94d4 Time: 0.00597905 [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0xbb88763c3b0e94d4 [04/18/2023-13:41:29] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:29] [V] [TRT] *************** Autotuning format combination: Int8(409600,6400,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:29] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:41:29] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:29] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.0170138 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0176025 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.017122 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.0162133 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.0173354 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.0127025 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.0132783 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.0131869 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.013723 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0126895 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0124629 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.0124552 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.012925 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0126556 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0178469 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0194537 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0136711 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0187577 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0191023 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0145879 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0129836 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0137534 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.018164 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.0152672 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0213538 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0181063 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0191343 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0135294 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0134832 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.0136187 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0200411 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0128362 [04/18/2023-13:41:29] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0122903 [04/18/2023-13:41:29] [V] [TRT] Fastest Tactic: 0x1ba323eb9858b2a9 Time: 0.0122903 [04/18/2023-13:41:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x1ba323eb9858b2a9 [04/18/2023-13:41:29] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:29] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv (CudaDepthwiseConvolution) [04/18/2023-13:41:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv (CaskFlattenConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv (CaskConvolution) [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 0xc25454de2efcccdc [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xc25454de2efcccdc Time: 0.025651 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: 0xff6944b17d5b2e32 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xff6944b17d5b2e32 Time: 0.0207608 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0194366 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.02045 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.0230713 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0273608 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.019452 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0264457 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 0x1db6e8cf1382fbe0 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x1db6e8cf1382fbe0 Time: 0.0191686 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: 0xa4ae2d82115c3e83 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xa4ae2d82115c3e83 Time: 0.0226847 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.0205832 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0235559 [04/18/2023-13:41:29] [V] [TRT] Fastest Tactic: 0x1db6e8cf1382fbe0 Time: 0.0191686 [04/18/2023-13:41:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x1db6e8cf1382fbe0 [04/18/2023-13:41:29] [V] [TRT] *************** Autotuning format combination: Int8(25600,6400:32,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv (CaskFlattenConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv (CaskConvolution) [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x733ba2a91a48d431 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x733ba2a91a48d431 Time: 0.0187246 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0xf04572b287451f42 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xf04572b287451f42 Time: 0.0238842 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x5e4f6d7c83746fd6 Time: 0.0239657 [04/18/2023-13:41:29] [V] [TRT] Fastest Tactic: 0x733ba2a91a48d431 Time: 0.0187246 [04/18/2023-13:41:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x733ba2a91a48d431 [04/18/2023-13:41:29] [V] [TRT] *************** Autotuning format combination: Int8(25600,6400:32,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv (CaskFlattenConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv (CaskConvolution) [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa71946688cad8664 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xa71946688cad8664 Time: 0.0164815 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x1e55f8b415964e81 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x1e55f8b415964e81 Time: 0.0204865 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.0244198 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9003f5f7ff9b1aec [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x9003f5f7ff9b1aec Time: 0.0199263 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9ec201b34455146e [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x9ec201b34455146e Time: 0.0179931 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x91930a570b557437 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x91930a570b557437 Time: 0.0198754 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdf7e1bd6a496d667 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xdf7e1bd6a496d667 Time: 0.0203046 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6d377e4222886190 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x6d377e4222886190 Time: 0.017473 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x271b998fe31732ef [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x271b998fe31732ef Time: 0.0199189 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.0213786 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x960e9baa2a6cad5b [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x960e9baa2a6cad5b Time: 0.0163347 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.0202931 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x84942841d92b0552 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x84942841d92b0552 Time: 0.0211187 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xbeb5d91e1874a437 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xbeb5d91e1874a437 Time: 0.0198977 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcd229658c16b33cd [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xcd229658c16b33cd Time: 0.02048 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.0206132 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.0204173 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x33a5c6dd086942c1 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x33a5c6dd086942c1 Time: 0.0186697 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7720f198395e7d3d [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x7720f198395e7d3d Time: 0.0194194 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0204173 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.020412 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x60b880e28fee7a0c [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x60b880e28fee7a0c Time: 0.0205009 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcf64a2ae51bf6b36 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xcf64a2ae51bf6b36 Time: 0.0187646 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x844ea9c00f711f19 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x844ea9c00f711f19 Time: 0.0198754 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x65fbe45b4cb1d8a5 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x65fbe45b4cb1d8a5 Time: 0.018304 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.0210789 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.0198217 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5bd8221bd57baf93 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x5bd8221bd57baf93 Time: 0.0179206 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0205433 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.0167096 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.0211664 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6e9c17a33c93d9b0 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x6e9c17a33c93d9b0 Time: 0.0195657 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.0213786 [04/18/2023-13:41:29] [V] [TRT] Fastest Tactic: 0x960e9baa2a6cad5b Time: 0.0163347 [04/18/2023-13:41:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x960e9baa2a6cad5b [04/18/2023-13:41:29] [V] [TRT] *************** Autotuning format combination: Int8(25600,6400:32,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv (CaskFlattenConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv (CaskConvolution) [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5812ced7874b44d1 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x5812ced7874b44d1 Time: 0.012107 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x43e3804f158e597d [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x43e3804f158e597d Time: 0.0106847 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7524377e24bc511f [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x7524377e24bc511f Time: 0.0133727 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x264d83735b1cba13 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x264d83735b1cba13 Time: 0.0112665 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3e116db8858d0d41 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x3e116db8858d0d41 Time: 0.0119459 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x758f8b2079a95b2e [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x758f8b2079a95b2e Time: 0.0109802 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7de8ad674a85e82a [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x7de8ad674a85e82a Time: 0.0126488 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x8f07802f58d278c0 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x8f07802f58d278c0 Time: 0.00985021 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x1cfa820c55616892 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x1cfa820c55616892 Time: 0.0103435 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xccdb99df0646c7b3 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xccdb99df0646c7b3 Time: 0.01407 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcf392eca056b8d88 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xcf392eca056b8d88 Time: 0.00986362 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x4f8662a723b489e1 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x4f8662a723b489e1 Time: 0.0133872 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x8e1dd2962c589dd4 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x8e1dd2962c589dd4 Time: 0.0101556 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xaba07efc49c11a6c [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xaba07efc49c11a6c Time: 0.00956282 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xd7985d83133bcf37 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xd7985d83133bcf37 Time: 0.0149248 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xb34706d47a62a016 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xb34706d47a62a016 Time: 0.0140305 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x8486adb55ae0ca6c [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x8486adb55ae0ca6c Time: 0.0101181 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x86d1488f426124e1 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x86d1488f426124e1 Time: 0.0131732 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcba01f45d37a76a0 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xcba01f45d37a76a0 Time: 0.0119001 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x62a338704beec449 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x62a338704beec449 Time: 0.00963352 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x68f52f0a3f1c5b56 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x68f52f0a3f1c5b56 Time: 0.0115137 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdb3ae212a7704d44 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xdb3ae212a7704d44 Time: 0.0138585 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x4e7f02f91ddf4673 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x4e7f02f91ddf4673 Time: 0.00983863 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xaceaca2c82ab40f3 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xaceaca2c82ab40f3 Time: 0.0154176 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xaa30815cbd0f74b7 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xaa30815cbd0f74b7 Time: 0.00926829 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6c336d1b7c64ffa3 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x6c336d1b7c64ffa3 Time: 0.0110836 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb7a90e7097d64877 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0xb7a90e7097d64877 Time: 0.0111142 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x682fae8be946411d [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x682fae8be946411d Time: 0.0113333 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x70ffb5fe2e1321e3 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x70ffb5fe2e1321e3 Time: 0.0107478 [04/18/2023-13:41:29] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x27fb8661fea664b3 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x27fb8661fea664b3 Time: 0.0105489 [04/18/2023-13:41:29] [V] [TRT] Fastest Tactic: 0xaa30815cbd0f74b7 Time: 0.00926829 [04/18/2023-13:41:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xaa30815cbd0f74b7 [04/18/2023-13:41:29] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:29] [V] [TRT] *************** Autotuning format combination: Int8(409600,1600,40,1) -> Int8(409600,1600,40,1) long-strided *************** [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] *************** Autotuning format combination: Int8(409600,1600,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(102400,1600:4,40,1) long-strided *************** [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:29] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(12800,1600:32,40,1) long-strided *************** [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:29] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Int8(12800,1600:32,40,1) long-strided *************** [04/18/2023-13:41:29] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:41:29] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:29] [V] [TRT] *************** Autotuning format combination: Int8(409600,1600,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:41:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:41:29] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:41:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:41:29] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:41:29] [V] [TRT] =============== Computing costs for [04/18/2023-13:41:29] [V] [TRT] *************** Autotuning format combination: Float(1632000,6400,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:41:29] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0221283 [04/18/2023-13:41:29] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0229982 [04/18/2023-13:41:30] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.022577 [04/18/2023-13:41:30] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.02285 [04/18/2023-13:41:30] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0223543 [04/18/2023-13:41:30] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0217757 [04/18/2023-13:41:30] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0237642 [04/18/2023-13:41:30] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0227736 [04/18/2023-13:41:31] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0223778 [04/18/2023-13:41:31] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0217502 [04/18/2023-13:41:31] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0229917 [04/18/2023-13:41:31] [V] [TRT] Fastest Tactic: 0x0000000000000009 Time: 0.0217502 [04/18/2023-13:41:31] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWise) [04/18/2023-13:41:31] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:41:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000009 [04/18/2023-13:41:31] [V] [TRT] *************** Autotuning format combination: Float(1632000,6400,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-13:41:31] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-13:41:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0181086 [04/18/2023-13:41:31] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0173232 [04/18/2023-13:41:31] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0157851 [04/18/2023-13:41:32] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0173755 [04/18/2023-13:41:32] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0160554 [04/18/2023-13:41:32] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0158842 [04/18/2023-13:41:32] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0183023 [04/18/2023-13:41:32] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0170621 [04/18/2023-13:41:32] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0159639 [04/18/2023-13:41:33] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0157403 [04/18/2023-13:41:33] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0179017 [04/18/2023-13:41:33] [V] [TRT] Fastest Tactic: 0x0000000000000009 Time: 0.0157403 [04/18/2023-13:41:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000009 [04/18/2023-13:41:33] [V] [TRT] *************** Autotuning format combination: Float(1632000,1,20400,255) -> Float(1632000,1,20400,255) *************** [04/18/2023-13:41:33] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-13:41:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0220891 [04/18/2023-13:41:33] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0219154 [04/18/2023-13:41:33] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0222106 [04/18/2023-13:41:33] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0231798 [04/18/2023-13:41:33] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0226691 [04/18/2023-13:41:33] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0222211 [04/18/2023-13:41:33] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0241189 [04/18/2023-13:41:33] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0228591 [04/18/2023-13:41:33] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0224353 [04/18/2023-13:41:33] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0216764 [04/18/2023-13:41:33] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0220317 [04/18/2023-13:41:33] [V] [TRT] Fastest Tactic: 0x0000000000000009 Time: 0.0216764 [04/18/2023-13:41:33] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWise) [04/18/2023-13:41:33] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:41:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000009 [04/18/2023-13:41:33] [V] [TRT] *************** Autotuning format combination: Float(409600,1:4,5120,64) -> Float(409600,1:4,5120,64) *************** [04/18/2023-13:41:33] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-13:41:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0225907 [04/18/2023-13:41:33] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0226325 [04/18/2023-13:41:33] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0224072 [04/18/2023-13:41:33] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0228891 [04/18/2023-13:41:34] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0223817 [04/18/2023-13:41:34] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0228428 [04/18/2023-13:41:34] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0228036 [04/18/2023-13:41:34] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0231184 [04/18/2023-13:41:34] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0231615 [04/18/2023-13:41:35] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0228434 [04/18/2023-13:41:35] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0230844 [04/18/2023-13:41:35] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0231184 [04/18/2023-13:41:35] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0221949 [04/18/2023-13:41:35] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0233437 [04/18/2023-13:41:36] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0226756 [04/18/2023-13:41:36] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0225241 [04/18/2023-13:41:36] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0234403 [04/18/2023-13:41:36] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0238766 [04/18/2023-13:41:36] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0228976 [04/18/2023-13:41:37] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0232862 [04/18/2023-13:41:37] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0232673 [04/18/2023-13:41:37] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0224784 [04/18/2023-13:41:37] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0238362 [04/18/2023-13:41:37] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.024221 [04/18/2023-13:41:37] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0222354 [04/18/2023-13:41:38] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0230583 [04/18/2023-13:41:38] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0227461 [04/18/2023-13:41:38] [V] [TRT] Fastest Tactic: 0x000000000000000c Time: 0.0221949 [04/18/2023-13:41:38] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWise) [04/18/2023-13:41:38] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:41:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000000c [04/18/2023-13:41:38] [V] [TRT] *************** Autotuning format combination: Float(51200,6400:32,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:41:38] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-13:41:38] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0223817 [04/18/2023-13:41:38] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0235278 [04/18/2023-13:41:38] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0239177 [04/18/2023-13:41:38] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0235938 [04/18/2023-13:41:39] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0224797 [04/18/2023-13:41:39] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.0223817 [04/18/2023-13:41:39] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWise) [04/18/2023-13:41:39] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:41:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-13:41:39] [V] [TRT] *************** Autotuning format combination: Float(51200,6400:32,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:41:39] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-13:41:39] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0162545 [04/18/2023-13:41:39] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0169178 [04/18/2023-13:41:39] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0167258 [04/18/2023-13:41:39] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0177011 [04/18/2023-13:41:40] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0175055 [04/18/2023-13:41:40] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0161615 [04/18/2023-13:41:40] [V] [TRT] Tactic: 0x000000000000001a Time: 0.017505 [04/18/2023-13:41:40] [V] [TRT] Tactic: 0x000000000000001b Time: 0.016189 [04/18/2023-13:41:40] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0169407 [04/18/2023-13:41:40] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0180303 [04/18/2023-13:41:40] [V] [TRT] Fastest Tactic: 0x0000000000000019 Time: 0.0161615 [04/18/2023-13:41:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000019 [04/18/2023-13:41:40] [V] [TRT] *************** Autotuning format combination: Float(1:4,6400,80,1) -> Float(1:4,6400,80,1) *************** [04/18/2023-13:41:40] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-13:41:40] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0819931 [04/18/2023-13:41:40] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0808023 [04/18/2023-13:41:40] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0812617 [04/18/2023-13:41:40] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.0808023 [04/18/2023-13:41:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [04/18/2023-13:41:40] [V] [TRT] *************** Autotuning format combination: Half(1632000,6400,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-13:41:40] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-13:41:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0191783 [04/18/2023-13:41:41] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0188589 [04/18/2023-13:41:41] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0185634 [04/18/2023-13:41:41] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0191749 [04/18/2023-13:41:41] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0188063 [04/18/2023-13:41:41] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.017251 [04/18/2023-13:41:42] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0198023 [04/18/2023-13:41:42] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0185149 [04/18/2023-13:41:42] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0181394 [04/18/2023-13:41:42] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0184503 [04/18/2023-13:41:42] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0189309 [04/18/2023-13:41:42] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.017251 [04/18/2023-13:41:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [04/18/2023-13:41:42] [V] [TRT] *************** Autotuning format combination: Half(1632000,6400,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-13:41:42] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-13:41:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0160422 [04/18/2023-13:41:43] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0132829 [04/18/2023-13:41:43] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0114465 [04/18/2023-13:41:43] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0120522 [04/18/2023-13:41:43] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0100547 [04/18/2023-13:41:43] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00903143 [04/18/2023-13:41:43] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0117623 [04/18/2023-13:41:43] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00987672 [04/18/2023-13:41:44] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00893114 [04/18/2023-13:41:44] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00778971 [04/18/2023-13:41:44] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0156818 [04/18/2023-13:41:44] [V] [TRT] Fastest Tactic: 0x0000000000000009 Time: 0.00778971 [04/18/2023-13:41:44] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWise) [04/18/2023-13:41:44] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:41:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000009 [04/18/2023-13:41:44] [V] [TRT] *************** Autotuning format combination: Half(819200,6400:2,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-13:41:44] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-13:41:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0139491 [04/18/2023-13:41:44] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0121379 [04/18/2023-13:41:45] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0119589 [04/18/2023-13:41:45] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0118643 [04/18/2023-13:41:45] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0121436 [04/18/2023-13:41:45] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0143515 [04/18/2023-13:41:45] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.01288 [04/18/2023-13:41:45] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0125055 [04/18/2023-13:41:46] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0150162 [04/18/2023-13:41:46] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0179537 [04/18/2023-13:41:46] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0228291 [04/18/2023-13:41:46] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0175614 [04/18/2023-13:41:46] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0147845 [04/18/2023-13:41:47] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0138847 [04/18/2023-13:41:47] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0115618 [04/18/2023-13:41:47] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0102854 [04/18/2023-13:41:47] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0132455 [04/18/2023-13:41:47] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.011212 [04/18/2023-13:41:47] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00989836 [04/18/2023-13:41:48] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00886561 [04/18/2023-13:41:48] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0140239 [04/18/2023-13:41:48] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0224816 [04/18/2023-13:41:48] [V] [TRT] Fastest Tactic: 0x0000000000000013 Time: 0.00886561 [04/18/2023-13:41:48] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWise) [04/18/2023-13:41:48] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:41:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000013 [04/18/2023-13:41:48] [V] [TRT] *************** Autotuning format combination: Half(204800,1:8,2560,32) -> Half(204800,1:8,2560,32) *************** [04/18/2023-13:41:48] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-13:41:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.014218 [04/18/2023-13:41:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0144347 [04/18/2023-13:41:48] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0155232 [04/18/2023-13:41:49] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0146263 [04/18/2023-13:41:49] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.015595 [04/18/2023-13:41:49] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0144206 [04/18/2023-13:41:49] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.014725 [04/18/2023-13:41:49] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0159077 [04/18/2023-13:41:50] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0136852 [04/18/2023-13:41:50] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0126571 [04/18/2023-13:41:50] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0112629 [04/18/2023-13:41:50] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0117317 [04/18/2023-13:41:50] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0145719 [04/18/2023-13:41:51] [V] [TRT] Tactic: 0x000000000000000d Time: 0.012091 [04/18/2023-13:41:51] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0138971 [04/18/2023-13:41:51] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0141228 [04/18/2023-13:41:51] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0152123 [04/18/2023-13:41:51] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0143657 [04/18/2023-13:41:52] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.014347 [04/18/2023-13:41:52] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0138186 [04/18/2023-13:41:52] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0133386 [04/18/2023-13:41:52] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.012776 [04/18/2023-13:41:52] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0124366 [04/18/2023-13:41:52] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0142084 [04/18/2023-13:41:53] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.020236 [04/18/2023-13:41:53] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0165623 [04/18/2023-13:41:53] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0135971 [04/18/2023-13:41:53] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0131109 [04/18/2023-13:41:53] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0133964 [04/18/2023-13:41:54] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0113438 [04/18/2023-13:41:54] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0138398 [04/18/2023-13:41:54] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0196349 [04/18/2023-13:41:54] [V] [TRT] Fastest Tactic: 0x000000000000000a Time: 0.0112629 [04/18/2023-13:41:54] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWise) [04/18/2023-13:41:54] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:41:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000000a [04/18/2023-13:41:54] [V] [TRT] *************** Autotuning format combination: Half(102400,1:16,1280,16) -> Half(102400,1:16,1280,16) *************** [04/18/2023-13:41:54] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-13:41:54] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0149669 [04/18/2023-13:41:54] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0146327 [04/18/2023-13:41:54] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0146738 [04/18/2023-13:41:55] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0151433 [04/18/2023-13:41:55] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0141253 [04/18/2023-13:41:55] [V] [TRT] Tactic: 0x000000000000000f Time: 0.014166 [04/18/2023-13:41:55] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0201097 [04/18/2023-13:41:55] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0149545 [04/18/2023-13:41:56] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0131823 [04/18/2023-13:41:56] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0132929 [04/18/2023-13:41:56] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0112141 [04/18/2023-13:41:56] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0119399 [04/18/2023-13:41:56] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0119421 [04/18/2023-13:41:57] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0159411 [04/18/2023-13:41:57] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0144827 [04/18/2023-13:41:57] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0130444 [04/18/2023-13:41:57] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0124099 [04/18/2023-13:41:57] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0140143 [04/18/2023-13:41:57] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0138689 [04/18/2023-13:41:58] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0120072 [04/18/2023-13:41:58] [V] [TRT] Tactic: 0x000000000000001f Time: 0.013423 [04/18/2023-13:41:58] [V] [TRT] Fastest Tactic: 0x0000000000000014 Time: 0.0112141 [04/18/2023-13:41:58] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWise) [04/18/2023-13:41:58] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:41:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000014 [04/18/2023-13:41:58] [V] [TRT] *************** Autotuning format combination: Half(51200,6400:32,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-13:41:58] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-13:41:58] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0187154 [04/18/2023-13:41:58] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.020316 [04/18/2023-13:41:58] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0200806 [04/18/2023-13:41:58] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0185051 [04/18/2023-13:41:59] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0183463 [04/18/2023-13:41:59] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.0183463 [04/18/2023-13:41:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:41:59] [V] [TRT] *************** Autotuning format combination: Half(51200,6400:32,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-13:41:59] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-13:41:59] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0137234 [04/18/2023-13:41:59] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.015584 [04/18/2023-13:41:59] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0120888 [04/18/2023-13:41:59] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0121611 [04/18/2023-13:41:59] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0124861 [04/18/2023-13:42:00] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0119954 [04/18/2023-13:42:00] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0123234 [04/18/2023-13:42:00] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0117609 [04/18/2023-13:42:00] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0154519 [04/18/2023-13:42:00] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0122979 [04/18/2023-13:42:00] [V] [TRT] Fastest Tactic: 0x000000000000001b Time: 0.0117609 [04/18/2023-13:42:00] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWise) [04/18/2023-13:42:00] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:42:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001b [04/18/2023-13:42:00] [V] [TRT] *************** Autotuning format combination: Half(1:8,6400,80,1) -> Half(1:8,6400,80,1) *************** [04/18/2023-13:42:00] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-13:42:00] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0977188 [04/18/2023-13:42:00] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0832983 [04/18/2023-13:42:00] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0842606 [04/18/2023-13:42:00] [V] [TRT] Tactic: 0x000000000000001f Time: 0.130048 [04/18/2023-13:42:00] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.0832983 [04/18/2023-13:42:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [04/18/2023-13:42:00] [V] [TRT] *************** Autotuning format combination: Half(1632000:32,6400,80,1) -> Half(1632000:32,6400,80,1) *************** [04/18/2023-13:42:00] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-13:42:00] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.380635 [04/18/2023-13:42:01] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.376832 [04/18/2023-13:42:01] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.380635 [04/18/2023-13:42:01] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.373321 [04/18/2023-13:42:01] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.322706 [04/18/2023-13:42:01] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.32651 [04/18/2023-13:42:01] [V] [TRT] Tactic: 0x000000000000001a Time: 0.336311 [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x000000000000001b Time: 0.3328 [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x000000000000001e Time: 0.381029 [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x000000000000001f Time: 0.329335 [04/18/2023-13:42:02] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.322706 [04/18/2023-13:42:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-13:42:02] [V] [TRT] =============== Computing costs for [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Float(1632000,6400,80,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Reshape + /model.77/Transpose (Shuffle) [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0299593 [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0493516 [04/18/2023-13:42:02] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0299593 [04/18/2023-13:42:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Float(1632000,1,20400,255) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Reshape + /model.77/Transpose (Shuffle) [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0912091 [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0500937 [04/18/2023-13:42:02] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0500937 [04/18/2023-13:42:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Float(409600,1:4,5120,64) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Reshape + /model.77/Transpose (Shuffle) [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.090624 [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0583116 [04/18/2023-13:42:02] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0583116 [04/18/2023-13:42:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Float(51200,6400:32,80,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Reshape + /model.77/Transpose (Shuffle) [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.125367 [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0591802 [04/18/2023-13:42:02] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0591802 [04/18/2023-13:42:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Half(1632000,6400,80,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Reshape + /model.77/Transpose (Shuffle) [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0257707 [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0635368 [04/18/2023-13:42:02] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0257707 [04/18/2023-13:42:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Half(819200,6400:2,80,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Reshape + /model.77/Transpose (Shuffle) [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0280069 [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0912091 [04/18/2023-13:42:02] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0280069 [04/18/2023-13:42:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Half(409600,1:4,5120,64) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Reshape + /model.77/Transpose (Shuffle) [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.090096 [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0533364 [04/18/2023-13:42:02] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0533364 [04/18/2023-13:42:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Half(204800,1:8,2560,32) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Reshape + /model.77/Transpose (Shuffle) [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0900389 [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0308315 [04/18/2023-13:42:02] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0308315 [04/18/2023-13:42:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Half(102400,1:16,1280,16) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Reshape + /model.77/Transpose (Shuffle) [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0901851 [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0308379 [04/18/2023-13:42:02] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0308379 [04/18/2023-13:42:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Half(51200,6400:32,80,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Reshape + /model.77/Transpose (Shuffle) [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0721349 [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0337042 [04/18/2023-13:42:02] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0337042 [04/18/2023-13:42:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:42:02] [V] [TRT] =============== Computing costs for [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Float(1632000,544000,6800,85,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Split (Slice) [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002984 [04/18/2023-13:42:02] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.002984 [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Split (Padding) [04/18/2023-13:42:02] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:42:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Half(1632000,544000,6800,85,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Split (Slice) [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00291984 [04/18/2023-13:42:02] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00291984 [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Split (Padding) [04/18/2023-13:42:02] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:42:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Half(816000,272000,6800:2,85,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Split (Padding) [04/18/2023-13:42:02] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Half(204000,68000,1:8,850,10) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Split (Padding) [04/18/2023-13:42:02] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:42:02] [V] [TRT] =============== Computing costs for [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Float(1632000,544000,6800,85,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Split_110 (Slice) [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00300657 [04/18/2023-13:42:02] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00300657 [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Split_110 (Padding) [04/18/2023-13:42:02] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:42:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Half(1632000,544000,6800,85,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Split_110 (Slice) [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00294307 [04/18/2023-13:42:02] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00294307 [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Split_110 (Padding) [04/18/2023-13:42:02] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:42:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Half(816000,272000,6800:2,85,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Split_110 (Padding) [04/18/2023-13:42:02] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Half(204000,68000,1:8,850,10) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Split_110 (Padding) [04/18/2023-13:42:02] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:42:02] [V] [TRT] =============== Computing costs for [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Float(1632000,544000,6800,85,1) -> Float(1632000,544000,6800,85,1) long-strided *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Split_111 (Slice) [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0221538 [04/18/2023-13:42:02] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0221538 [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Split_111 (Padding) [04/18/2023-13:42:02] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:42:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Float(1632000,544000,6800,85,1) -> Float(1555200,518400,6480,81,1) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Split_111 (Slice) [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0217659 [04/18/2023-13:42:02] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0217659 [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Split_111 (Padding) [04/18/2023-13:42:02] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:42:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Half(1632000,544000,6800,85,1) -> Half(1632000,544000,6800,85,1) long-strided *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Split_111 (Slice) [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0147301 [04/18/2023-13:42:02] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0147301 [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Split_111 (Padding) [04/18/2023-13:42:02] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:42:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Half(1632000,544000,6800,85,1) -> Half(1555200,518400,6480,81,1) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Split_111 (Slice) [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0137612 [04/18/2023-13:42:02] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0137612 [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Split_111 (Padding) [04/18/2023-13:42:02] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:42:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Half(816000,272000,6800:2,85,1) -> Half(816000,272000,6800:2,85,1) long-strided *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Split_111 (Padding) [04/18/2023-13:42:02] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Half(816000,272000,6800:2,85,1) -> Half(777600,259200,6480:2,81,1) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Split_111 (Padding) [04/18/2023-13:42:02] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Half(204000,68000,1:8,850,10) -> Half(204000,68000,1:8,850,10) long-strided *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Split_111 (Padding) [04/18/2023-13:42:02] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Half(204000,68000,1:8,850,10) -> Half(194400,64800,1:8,810,10) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: /model.77/Split_111 (Padding) [04/18/2023-13:42:02] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:42:02] [V] [TRT] =============== Computing costs for [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:42:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:42:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:4,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:42:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:42:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:42:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:42:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:42:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:42:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Int8(3200,1600:32,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:42:02] [V] [TRT] =============== Computing costs for [04/18/2023-13:42:02] [V] [TRT] *************** Autotuning format combination: Float(38400,12800,160,2,1), Float(12800,12800,160,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:42:02] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00294988 [04/18/2023-13:42:02] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00286281 [04/18/2023-13:42:03] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00280767 [04/18/2023-13:42:03] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00322702 [04/18/2023-13:42:03] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00302848 [04/18/2023-13:42:03] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00302733 [04/18/2023-13:42:03] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00385588 [04/18/2023-13:42:03] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.003264 [04/18/2023-13:42:04] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00304866 [04/18/2023-13:42:04] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00307307 [04/18/2023-13:42:04] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00296145 [04/18/2023-13:42:04] [V] [TRT] Fastest Tactic: 0x0000000000000002 Time: 0.00280767 [04/18/2023-13:42:04] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWise) [04/18/2023-13:42:04] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:42:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 [04/18/2023-13:42:04] [V] [TRT] *************** Autotuning format combination: Float(38400,12800,160,2,1), Float(12800,12800,160,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:42:04] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-13:42:04] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00293477 [04/18/2023-13:42:04] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00293094 [04/18/2023-13:42:04] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00285742 [04/18/2023-13:42:05] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00321361 [04/18/2023-13:42:05] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00302438 [04/18/2023-13:42:05] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0029662 [04/18/2023-13:42:05] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00387583 [04/18/2023-13:42:05] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00336298 [04/18/2023-13:42:05] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00302448 [04/18/2023-13:42:06] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00310589 [04/18/2023-13:42:06] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0028747 [04/18/2023-13:42:06] [V] [TRT] Fastest Tactic: 0x0000000000000002 Time: 0.00285742 [04/18/2023-13:42:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 [04/18/2023-13:42:06] [V] [TRT] *************** Autotuning format combination: Float(38400,12800,1,160,80), Float(12800,12800,1,160,80) -> Float(38400,12800,1,160,80) *************** [04/18/2023-13:42:06] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-13:42:06] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00280255 [04/18/2023-13:42:06] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0028316 [04/18/2023-13:42:06] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00266108 [04/18/2023-13:42:06] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00313858 [04/18/2023-13:42:06] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00296854 [04/18/2023-13:42:06] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00280273 [04/18/2023-13:42:06] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00380932 [04/18/2023-13:42:06] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00322631 [04/18/2023-13:42:06] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00299476 [04/18/2023-13:42:06] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00297768 [04/18/2023-13:42:06] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00274122 [04/18/2023-13:42:06] [V] [TRT] Fastest Tactic: 0x0000000000000002 Time: 0.00266108 [04/18/2023-13:42:06] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWise) [04/18/2023-13:42:06] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:42:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 [04/18/2023-13:42:06] [V] [TRT] *************** Autotuning format combination: Float(9600,3200,1:4,40,20), Float(3200,3200,1:4,40,20) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-13:42:06] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-13:42:06] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00296611 [04/18/2023-13:42:06] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00324997 [04/18/2023-13:42:06] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00388596 [04/18/2023-13:42:06] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00387818 [04/18/2023-13:42:07] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00373134 [04/18/2023-13:42:07] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0037413 [04/18/2023-13:42:07] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00520294 [04/18/2023-13:42:07] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00518922 [04/18/2023-13:42:07] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00518024 [04/18/2023-13:42:08] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00545321 [04/18/2023-13:42:08] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00298791 [04/18/2023-13:42:08] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00301924 [04/18/2023-13:42:08] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00317968 [04/18/2023-13:42:08] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00342117 [04/18/2023-13:42:08] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00371352 [04/18/2023-13:42:09] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00380138 [04/18/2023-13:42:09] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00427496 [04/18/2023-13:42:09] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00462289 [04/18/2023-13:42:09] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00514955 [04/18/2023-13:42:09] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00611886 [04/18/2023-13:42:10] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00299619 [04/18/2023-13:42:10] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00307132 [04/18/2023-13:42:10] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00320599 [04/18/2023-13:42:10] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00383218 [04/18/2023-13:42:10] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00295249 [04/18/2023-13:42:10] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00278119 [04/18/2023-13:42:11] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00295361 [04/18/2023-13:42:11] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.00278119 [04/18/2023-13:42:11] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWise) [04/18/2023-13:42:11] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:42:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [04/18/2023-13:42:11] [V] [TRT] *************** Autotuning format combination: Float(1440,480,160:32,2,1), Float(480,480,160:32,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:42:11] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-13:42:11] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00319695 [04/18/2023-13:42:11] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00383483 [04/18/2023-13:42:11] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0051711 [04/18/2023-13:42:11] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0074384 [04/18/2023-13:42:11] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00316542 [04/18/2023-13:42:11] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00316542 [04/18/2023-13:42:11] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWise) [04/18/2023-13:42:11] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:42:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:42:11] [V] [TRT] *************** Autotuning format combination: Float(1440,480,160:32,2,1), Float(480,480,160:32,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:42:11] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-13:42:12] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0035549 [04/18/2023-13:42:12] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00580041 [04/18/2023-13:42:12] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00832305 [04/18/2023-13:42:12] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0141428 [04/18/2023-13:42:12] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00319807 [04/18/2023-13:42:13] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00366945 [04/18/2023-13:42:13] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00461877 [04/18/2023-13:42:13] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00686563 [04/18/2023-13:42:13] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00355479 [04/18/2023-13:42:13] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00316005 [04/18/2023-13:42:13] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00316005 [04/18/2023-13:42:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:42:13] [V] [TRT] *************** Autotuning format combination: Float(12800,1:4,160,2,1), Float(12800,1:4,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:42:13] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-13:42:14] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00309738 [04/18/2023-13:42:14] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00310128 [04/18/2023-13:42:14] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00300572 [04/18/2023-13:42:14] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.00300572 [04/18/2023-13:42:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [04/18/2023-13:42:14] [V] [TRT] *************** Autotuning format combination: Half(38400,12800,160,2,1), Half(12800,12800,160,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:42:14] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-13:42:14] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00299762 [04/18/2023-13:42:14] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00297971 [04/18/2023-13:42:14] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00277477 [04/18/2023-13:42:15] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00329996 [04/18/2023-13:42:15] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00308513 [04/18/2023-13:42:15] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00281376 [04/18/2023-13:42:15] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00386656 [04/18/2023-13:42:15] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00341497 [04/18/2023-13:42:15] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00309291 [04/18/2023-13:42:16] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00291965 [04/18/2023-13:42:16] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00293448 [04/18/2023-13:42:16] [V] [TRT] Fastest Tactic: 0x0000000000000002 Time: 0.00277477 [04/18/2023-13:42:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 [04/18/2023-13:42:16] [V] [TRT] *************** Autotuning format combination: Half(38400,12800,160,2,1), Half(12800,12800,160,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:42:16] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-13:42:16] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00293878 [04/18/2023-13:42:16] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00289966 [04/18/2023-13:42:16] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00282299 [04/18/2023-13:42:16] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00319116 [04/18/2023-13:42:17] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00318578 [04/18/2023-13:42:17] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00288796 [04/18/2023-13:42:17] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00383844 [04/18/2023-13:42:17] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00344283 [04/18/2023-13:42:17] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00306402 [04/18/2023-13:42:18] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00304314 [04/18/2023-13:42:18] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0030101 [04/18/2023-13:42:18] [V] [TRT] Fastest Tactic: 0x0000000000000002 Time: 0.00282299 [04/18/2023-13:42:18] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWise) [04/18/2023-13:42:18] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:42:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 [04/18/2023-13:42:18] [V] [TRT] *************** Autotuning format combination: Half(19200,6400,160:2,2,1), Half(6400,6400,160:2,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:42:18] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-13:42:18] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00277512 [04/18/2023-13:42:18] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00305245 [04/18/2023-13:42:18] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00298086 [04/18/2023-13:42:18] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00336011 [04/18/2023-13:42:19] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00338509 [04/18/2023-13:42:19] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00341529 [04/18/2023-13:42:19] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00438261 [04/18/2023-13:42:19] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00433981 [04/18/2023-13:42:19] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00436932 [04/18/2023-13:42:19] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00445493 [04/18/2023-13:42:20] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00290752 [04/18/2023-13:42:20] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00287296 [04/18/2023-13:42:20] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00284217 [04/18/2023-13:42:20] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00333448 [04/18/2023-13:42:20] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00309972 [04/18/2023-13:42:21] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0029371 [04/18/2023-13:42:21] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00396701 [04/18/2023-13:42:21] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00354754 [04/18/2023-13:42:21] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00332917 [04/18/2023-13:42:21] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00323952 [04/18/2023-13:42:21] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00302895 [04/18/2023-13:42:22] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0031363 [04/18/2023-13:42:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00277512 [04/18/2023-13:42:22] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWise) [04/18/2023-13:42:22] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:42:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [04/18/2023-13:42:22] [V] [TRT] *************** Autotuning format combination: Half(4800,1600,1:8,20,10), Half(1600,1600,1:8,20,10) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:42:22] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-13:42:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00279912 [04/18/2023-13:42:22] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00327252 [04/18/2023-13:42:22] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00346503 [04/18/2023-13:42:22] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00399339 [04/18/2023-13:42:23] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00443276 [04/18/2023-13:42:23] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00429176 [04/18/2023-13:42:23] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00548216 [04/18/2023-13:42:23] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00653382 [04/18/2023-13:42:23] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00629843 [04/18/2023-13:42:24] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00622867 [04/18/2023-13:42:24] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00295809 [04/18/2023-13:42:24] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00322987 [04/18/2023-13:42:24] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00316293 [04/18/2023-13:42:24] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00375056 [04/18/2023-13:42:25] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00386928 [04/18/2023-13:42:25] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00375455 [04/18/2023-13:42:25] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00495921 [04/18/2023-13:42:25] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00525633 [04/18/2023-13:42:25] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00515069 [04/18/2023-13:42:26] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00527037 [04/18/2023-13:42:26] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00282469 [04/18/2023-13:42:26] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0030827 [04/18/2023-13:42:26] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0034572 [04/18/2023-13:42:26] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00456543 [04/18/2023-13:42:26] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00298867 [04/18/2023-13:42:27] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00297924 [04/18/2023-13:42:27] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00339179 [04/18/2023-13:42:27] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00405486 [04/18/2023-13:42:27] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00284361 [04/18/2023-13:42:27] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00281242 [04/18/2023-13:42:27] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00277829 [04/18/2023-13:42:28] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00297714 [04/18/2023-13:42:28] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.00277829 [04/18/2023-13:42:28] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWise) [04/18/2023-13:42:28] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:42:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [04/18/2023-13:42:28] [V] [TRT] *************** Autotuning format combination: Half(2400,800,1:16,10,5), Half(800,800,1:16,10,5) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-13:42:28] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-13:42:28] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00294046 [04/18/2023-13:42:28] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00326192 [04/18/2023-13:42:28] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00339753 [04/18/2023-13:42:28] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00409156 [04/18/2023-13:42:29] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00454971 [04/18/2023-13:42:29] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00435934 [04/18/2023-13:42:29] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00601048 [04/18/2023-13:42:29] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00664519 [04/18/2023-13:42:29] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00626325 [04/18/2023-13:42:30] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00644392 [04/18/2023-13:42:30] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00283554 [04/18/2023-13:42:30] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00314305 [04/18/2023-13:42:30] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00377131 [04/18/2023-13:42:30] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00499594 [04/18/2023-13:42:30] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00283034 [04/18/2023-13:42:31] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0030359 [04/18/2023-13:42:31] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0035093 [04/18/2023-13:42:31] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00450286 [04/18/2023-13:42:31] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00279156 [04/18/2023-13:42:31] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0028506 [04/18/2023-13:42:31] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00282864 [04/18/2023-13:42:31] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.00279156 [04/18/2023-13:42:31] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWise) [04/18/2023-13:42:31] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:42:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [04/18/2023-13:42:31] [V] [TRT] *************** Autotuning format combination: Half(1440,480,160:32,2,1), Half(480,480,160:32,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:42:31] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-13:42:32] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00302886 [04/18/2023-13:42:32] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00299647 [04/18/2023-13:42:32] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00364869 [04/18/2023-13:42:32] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00469958 [04/18/2023-13:42:32] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00304914 [04/18/2023-13:42:32] [V] [TRT] Fastest Tactic: 0x0000000000000019 Time: 0.00299647 [04/18/2023-13:42:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000019 [04/18/2023-13:42:32] [V] [TRT] *************** Autotuning format combination: Half(1440,480,160:32,2,1), Half(480,480,160:32,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:42:32] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-13:42:33] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00301629 [04/18/2023-13:42:33] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00368645 [04/18/2023-13:42:33] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00482743 [04/18/2023-13:42:33] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00718034 [04/18/2023-13:42:33] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00307803 [04/18/2023-13:42:34] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00315756 [04/18/2023-13:42:34] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00370309 [04/18/2023-13:42:34] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00493052 [04/18/2023-13:42:34] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00307647 [04/18/2023-13:42:34] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00296238 [04/18/2023-13:42:34] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00296238 [04/18/2023-13:42:34] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWise) [04/18/2023-13:42:34] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:42:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:42:34] [V] [TRT] *************** Autotuning format combination: Half(12800,1:8,160,2,1), Half(12800,1:8,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:42:34] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-13:42:34] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00328675 [04/18/2023-13:42:35] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00331906 [04/18/2023-13:42:35] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0035045 [04/18/2023-13:42:35] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00345785 [04/18/2023-13:42:35] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00328675 [04/18/2023-13:42:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-13:42:35] [V] [TRT] *************** Autotuning format combination: Half(12800,12800:32,160,2,1), Half(12800,12800:32,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:42:35] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-13:42:35] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00506719 [04/18/2023-13:42:35] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00526416 [04/18/2023-13:42:36] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00597676 [04/18/2023-13:42:36] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00765426 [04/18/2023-13:42:36] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00502873 [04/18/2023-13:42:36] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00559683 [04/18/2023-13:42:36] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00546573 [04/18/2023-13:42:37] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00682101 [04/18/2023-13:42:37] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00515429 [04/18/2023-13:42:37] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00523886 [04/18/2023-13:42:37] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.00502873 [04/18/2023-13:42:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-13:42:37] [V] [TRT] =============== Computing costs for [04/18/2023-13:42:37] [V] [TRT] *************** Autotuning format combination: Float(38400,12800,160,2,1), Float(6,2,2,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:42:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-13:42:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0109499 [04/18/2023-13:42:37] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0128625 [04/18/2023-13:42:37] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0118604 [04/18/2023-13:42:38] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0147054 [04/18/2023-13:42:38] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0153527 [04/18/2023-13:42:38] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0135285 [04/18/2023-13:42:38] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0178463 [04/18/2023-13:42:38] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0182903 [04/18/2023-13:42:38] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0183446 [04/18/2023-13:42:39] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0168554 [04/18/2023-13:42:39] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00309447 [04/18/2023-13:42:39] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00309447 [04/18/2023-13:42:39] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWise) [04/18/2023-13:42:39] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:42:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-13:42:39] [V] [TRT] *************** Autotuning format combination: Float(38400,12800,160,2,1), Float(6,2,2,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:42:39] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-13:42:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0112978 [04/18/2023-13:42:39] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0130606 [04/18/2023-13:42:39] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0119059 [04/18/2023-13:42:39] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0149024 [04/18/2023-13:42:40] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0159726 [04/18/2023-13:42:40] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0132468 [04/18/2023-13:42:40] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.018144 [04/18/2023-13:42:40] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0200771 [04/18/2023-13:42:40] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.018444 [04/18/2023-13:42:40] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0165851 [04/18/2023-13:42:41] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00316889 [04/18/2023-13:42:41] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00316889 [04/18/2023-13:42:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-13:42:41] [V] [TRT] *************** Autotuning format combination: Float(38400,12800,1,160,80), Float(6,2,1,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-13:42:41] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-13:42:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00308902 [04/18/2023-13:42:41] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00307287 [04/18/2023-13:42:41] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00306733 [04/18/2023-13:42:41] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0031875 [04/18/2023-13:42:41] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00308114 [04/18/2023-13:42:42] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00276677 [04/18/2023-13:42:42] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00340735 [04/18/2023-13:42:42] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00327325 [04/18/2023-13:42:42] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00302276 [04/18/2023-13:42:42] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00300219 [04/18/2023-13:42:42] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00299505 [04/18/2023-13:42:42] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.00276677 [04/18/2023-13:42:42] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWise) [04/18/2023-13:42:42] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:42:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [04/18/2023-13:42:42] [V] [TRT] *************** Autotuning format combination: Float(9600,3200,1:4,40,20), Float(6,2,1:4,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-13:42:42] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-13:42:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00307044 [04/18/2023-13:42:43] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00312437 [04/18/2023-13:42:43] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0035824 [04/18/2023-13:42:43] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00329174 [04/18/2023-13:42:43] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00340528 [04/18/2023-13:42:44] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00337882 [04/18/2023-13:42:44] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00352457 [04/18/2023-13:42:44] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00374107 [04/18/2023-13:42:44] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00332757 [04/18/2023-13:42:44] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00353472 [04/18/2023-13:42:45] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00306412 [04/18/2023-13:42:45] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0031357 [04/18/2023-13:42:45] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00338955 [04/18/2023-13:42:45] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0033365 [04/18/2023-13:42:45] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00341105 [04/18/2023-13:42:45] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00357577 [04/18/2023-13:42:46] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00347788 [04/18/2023-13:42:46] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0035578 [04/18/2023-13:42:46] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00372372 [04/18/2023-13:42:46] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00398971 [04/18/2023-13:42:46] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0031356 [04/18/2023-13:42:47] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00320985 [04/18/2023-13:42:47] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00322164 [04/18/2023-13:42:47] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00336457 [04/18/2023-13:42:47] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00290697 [04/18/2023-13:42:47] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00299476 [04/18/2023-13:42:47] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00320081 [04/18/2023-13:42:47] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00290697 [04/18/2023-13:42:47] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWise) [04/18/2023-13:42:47] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:42:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-13:42:47] [V] [TRT] *************** Autotuning format combination: Float(1440,480,160:32,2,1), Float(6,2,2:32,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:42:47] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-13:42:48] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00323789 [04/18/2023-13:42:48] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00360217 [04/18/2023-13:42:48] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00370673 [04/18/2023-13:42:48] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00417149 [04/18/2023-13:42:48] [V] [TRT] Tactic: 0x000000000000001f Time: 0.003272 [04/18/2023-13:42:48] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.00323789 [04/18/2023-13:42:48] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWise) [04/18/2023-13:42:48] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:42:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-13:42:48] [V] [TRT] *************** Autotuning format combination: Float(1440,480,160:32,2,1), Float(6,2,2:32,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:42:48] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-13:42:49] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00389659 [04/18/2023-13:42:49] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00502306 [04/18/2023-13:42:49] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00547725 [04/18/2023-13:42:49] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00600914 [04/18/2023-13:42:49] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00323738 [04/18/2023-13:42:50] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00344239 [04/18/2023-13:42:50] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00371059 [04/18/2023-13:42:50] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00402425 [04/18/2023-13:42:50] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00337818 [04/18/2023-13:42:50] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00304 [04/18/2023-13:42:50] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00304 [04/18/2023-13:42:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:42:50] [V] [TRT] *************** Autotuning format combination: Float(12800,1:4,160,2,1), Float(2,1:4,2,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-13:42:50] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-13:42:51] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00312427 [04/18/2023-13:42:51] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00309758 [04/18/2023-13:42:51] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00341159 [04/18/2023-13:42:51] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.00309758 [04/18/2023-13:42:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [04/18/2023-13:42:51] [V] [TRT] *************** Autotuning format combination: Half(38400,12800,160,2,1), Half(6,2,2,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-13:42:51] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-13:42:51] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0109727 [04/18/2023-13:42:51] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0132642 [04/18/2023-13:42:51] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0122251 [04/18/2023-13:42:52] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0151712 [04/18/2023-13:42:52] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0161595 [04/18/2023-13:42:52] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.013034 [04/18/2023-13:42:52] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0189789 [04/18/2023-13:42:52] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0200023 [04/18/2023-13:42:52] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0183434 [04/18/2023-13:42:53] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0167568 [04/18/2023-13:42:53] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00320731 [04/18/2023-13:42:53] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00320731 [04/18/2023-13:42:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-13:42:53] [V] [TRT] *************** Autotuning format combination: Half(38400,12800,160,2,1), Half(6,2,2,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-13:42:53] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-13:42:53] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0110326 [04/18/2023-13:42:53] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0132484 [04/18/2023-13:42:53] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0122895 [04/18/2023-13:42:53] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0155749 [04/18/2023-13:42:54] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.015997 [04/18/2023-13:42:54] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.013445 [04/18/2023-13:42:54] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0191503 [04/18/2023-13:42:54] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0199731 [04/18/2023-13:42:54] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.018688 [04/18/2023-13:42:54] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0163992 [04/18/2023-13:42:55] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00309301 [04/18/2023-13:42:55] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00309301 [04/18/2023-13:42:55] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWise) [04/18/2023-13:42:55] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:42:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-13:42:55] [V] [TRT] *************** Autotuning format combination: Half(19200,6400,160:2,2,1), Half(6,2,2:2,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-13:42:55] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-13:42:55] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00774159 [04/18/2023-13:42:55] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00906457 [04/18/2023-13:42:55] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00824965 [04/18/2023-13:42:55] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0106949 [04/18/2023-13:42:56] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0099968 [04/18/2023-13:42:56] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00822044 [04/18/2023-13:42:56] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0138402 [04/18/2023-13:42:56] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0116515 [04/18/2023-13:42:56] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.010462 [04/18/2023-13:42:56] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00906571 [04/18/2023-13:42:57] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00724069 [04/18/2023-13:42:57] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00874944 [04/18/2023-13:42:57] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00753034 [04/18/2023-13:42:57] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0105809 [04/18/2023-13:42:57] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0095485 [04/18/2023-13:42:58] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00759579 [04/18/2023-13:42:58] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.014347 [04/18/2023-13:42:58] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0116673 [04/18/2023-13:42:58] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0100757 [04/18/2023-13:42:58] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00811733 [04/18/2023-13:42:58] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00313361 [04/18/2023-13:42:59] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00320843 [04/18/2023-13:42:59] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00313361 [04/18/2023-13:42:59] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWise) [04/18/2023-13:42:59] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:42:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-13:42:59] [V] [TRT] *************** Autotuning format combination: Half(4800,1600,1:8,20,10), Half(6,2,1:8,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-13:42:59] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-13:42:59] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0033869 [04/18/2023-13:42:59] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00355791 [04/18/2023-13:42:59] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00365611 [04/18/2023-13:42:59] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00373029 [04/18/2023-13:43:00] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00383856 [04/18/2023-13:43:00] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00371704 [04/18/2023-13:43:00] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0042119 [04/18/2023-13:43:00] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00439882 [04/18/2023-13:43:00] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00404266 [04/18/2023-13:43:01] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00390314 [04/18/2023-13:43:01] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00323992 [04/18/2023-13:43:01] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00335245 [04/18/2023-13:43:01] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00340473 [04/18/2023-13:43:01] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00350484 [04/18/2023-13:43:02] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00347091 [04/18/2023-13:43:02] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00329735 [04/18/2023-13:43:02] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00394947 [04/18/2023-13:43:02] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00371012 [04/18/2023-13:43:02] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00359669 [04/18/2023-13:43:03] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00352323 [04/18/2023-13:43:03] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00321869 [04/18/2023-13:43:03] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00343695 [04/18/2023-13:43:03] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00369805 [04/18/2023-13:43:03] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00407759 [04/18/2023-13:43:03] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00319736 [04/18/2023-13:43:04] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00324987 [04/18/2023-13:43:04] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00319797 [04/18/2023-13:43:04] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00354743 [04/18/2023-13:43:04] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00317466 [04/18/2023-13:43:04] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00304185 [04/18/2023-13:43:05] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00303724 [04/18/2023-13:43:05] [V] [TRT] Tactic: 0x000000000000001f Time: 0.003151 [04/18/2023-13:43:05] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.00303724 [04/18/2023-13:43:05] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWise) [04/18/2023-13:43:05] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [04/18/2023-13:43:05] [V] [TRT] *************** Autotuning format combination: Half(2400,800,1:16,10,5), Half(6,2,1:16,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-13:43:05] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-13:43:05] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00345556 [04/18/2023-13:43:05] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0036512 [04/18/2023-13:43:05] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00358034 [04/18/2023-13:43:05] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00374482 [04/18/2023-13:43:06] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00387385 [04/18/2023-13:43:06] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00379308 [04/18/2023-13:43:06] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00427321 [04/18/2023-13:43:06] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00439425 [04/18/2023-13:43:07] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00409091 [04/18/2023-13:43:07] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00392661 [04/18/2023-13:43:07] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00320741 [04/18/2023-13:43:07] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00337892 [04/18/2023-13:43:07] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00351933 [04/18/2023-13:43:08] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00395194 [04/18/2023-13:43:08] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00335075 [04/18/2023-13:43:08] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00359429 [04/18/2023-13:43:08] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0037413 [04/18/2023-13:43:08] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00413832 [04/18/2023-13:43:08] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00324307 [04/18/2023-13:43:09] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00311076 [04/18/2023-13:43:09] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00305887 [04/18/2023-13:43:09] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00305887 [04/18/2023-13:43:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWise) [04/18/2023-13:43:09] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:43:09] [V] [TRT] *************** Autotuning format combination: Half(1440,480,160:32,2,1), Half(6,2,2:32,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-13:43:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-13:43:09] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00308387 [04/18/2023-13:43:09] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00332662 [04/18/2023-13:43:09] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00370848 [04/18/2023-13:43:10] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0039297 [04/18/2023-13:43:10] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00308464 [04/18/2023-13:43:10] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.00308387 [04/18/2023-13:43:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-13:43:10] [V] [TRT] *************** Autotuning format combination: Half(1440,480,160:32,2,1), Half(6,2,2:32,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-13:43:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-13:43:10] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00342824 [04/18/2023-13:43:10] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00387212 [04/18/2023-13:43:10] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00466994 [04/18/2023-13:43:11] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00623086 [04/18/2023-13:43:11] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00312775 [04/18/2023-13:43:11] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00340354 [04/18/2023-13:43:11] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00367578 [04/18/2023-13:43:11] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00450557 [04/18/2023-13:43:11] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0030685 [04/18/2023-13:43:12] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00310698 [04/18/2023-13:43:12] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.0030685 [04/18/2023-13:43:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWise) [04/18/2023-13:43:12] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [04/18/2023-13:43:12] [V] [TRT] *************** Autotuning format combination: Half(12800,1:8,160,2,1), Half(2,1:8,2,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-13:43:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-13:43:12] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00322529 [04/18/2023-13:43:12] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00333831 [04/18/2023-13:43:12] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00368059 [04/18/2023-13:43:12] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00452243 [04/18/2023-13:43:12] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00322529 [04/18/2023-13:43:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-13:43:12] [V] [TRT] *************** Autotuning format combination: Half(12800,12800:32,160,2,1), Half(2,2:32,2,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-13:43:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-13:43:13] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00929772 [04/18/2023-13:43:13] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0124221 [04/18/2023-13:43:13] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0177006 [04/18/2023-13:43:13] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0291173 [04/18/2023-13:43:13] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00733303 [04/18/2023-13:43:14] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00895914 [04/18/2023-13:43:14] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0117679 [04/18/2023-13:43:14] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0177737 [04/18/2023-13:43:14] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00471373 [04/18/2023-13:43:14] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00509446 [04/18/2023-13:43:14] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.00471373 [04/18/2023-13:43:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [04/18/2023-13:43:14] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:14] [V] [TRT] *************** Autotuning format combination: Float(1632000,544000,6800,85,1) -> Float(1632000,85,1) *************** [04/18/2023-13:43:14] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1 (Shuffle) [04/18/2023-13:43:14] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0252587 [04/18/2023-13:43:14] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0467051 [04/18/2023-13:43:14] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0252587 [04/18/2023-13:43:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-13:43:14] [V] [TRT] *************** Autotuning format combination: Float(1632000,544000,1,6800,80) -> Float(1,85,1) *************** [04/18/2023-13:43:14] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1 (Shuffle) [04/18/2023-13:43:14] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0360229 [04/18/2023-13:43:14] [V] [TRT] Tactic: 0x0000000000000001 Time: 1.08091 [04/18/2023-13:43:14] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0360229 [04/18/2023-13:43:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-13:43:14] [V] [TRT] *************** Autotuning format combination: Float(408000,136000,1:4,1700,20) -> Float(1:4,85,1) *************** [04/18/2023-13:43:14] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1 (Shuffle) [04/18/2023-13:43:14] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.859721 [04/18/2023-13:43:14] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.146139 [04/18/2023-13:43:14] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.146139 [04/18/2023-13:43:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:43:14] [V] [TRT] *************** Autotuning format combination: Float(61200,20400,6800:32,85,1) -> Float(1632000:32,85,1) *************** [04/18/2023-13:43:14] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1 (Shuffle) [04/18/2023-13:43:14] [V] [TRT] Tactic: 0x0000000000000000 Time: 8.25768 [04/18/2023-13:43:14] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.683447 [04/18/2023-13:43:14] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.683447 [04/18/2023-13:43:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:43:14] [V] [TRT] *************** Autotuning format combination: Half(1632000,544000,6800,85,1) -> Half(1632000,85,1) *************** [04/18/2023-13:43:14] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1 (Shuffle) [04/18/2023-13:43:14] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0158592 [04/18/2023-13:43:14] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.070685 [04/18/2023-13:43:14] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0158592 [04/18/2023-13:43:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-13:43:14] [V] [TRT] *************** Autotuning format combination: Half(816000,272000,6800:2,85,1) -> Half(1632000:2,85,1) *************** [04/18/2023-13:43:14] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1 (Shuffle) [04/18/2023-13:43:14] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.212553 [04/18/2023-13:43:14] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.07936 [04/18/2023-13:43:14] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.07936 [04/18/2023-13:43:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:43:14] [V] [TRT] *************** Autotuning format combination: Half(408000,136000,1:4,1700,20) -> Half(1:4,85,1) *************** [04/18/2023-13:43:14] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1 (Shuffle) [04/18/2023-13:43:14] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.462994 [04/18/2023-13:43:14] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.21504 [04/18/2023-13:43:14] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.21504 [04/18/2023-13:43:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:43:14] [V] [TRT] *************** Autotuning format combination: Half(204000,68000,1:8,850,10) -> Half(1:8,85,1) *************** [04/18/2023-13:43:14] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1 (Shuffle) [04/18/2023-13:43:14] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.979259 [04/18/2023-13:43:14] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.13824 [04/18/2023-13:43:14] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.13824 [04/18/2023-13:43:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:43:14] [V] [TRT] *************** Autotuning format combination: Half(102000,34000,1:16,425,5) -> Half(1:16,85,1) *************** [04/18/2023-13:43:14] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1 (Shuffle) [04/18/2023-13:43:14] [V] [TRT] Tactic: 0x0000000000000000 Time: 2.05429 [04/18/2023-13:43:14] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.213413 [04/18/2023-13:43:14] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.213413 [04/18/2023-13:43:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:43:14] [V] [TRT] *************** Autotuning format combination: Half(61200,20400,6800:32,85,1) -> Half(1632000:32,85,1) *************** [04/18/2023-13:43:14] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1 (Shuffle) [04/18/2023-13:43:14] [V] [TRT] Tactic: 0x0000000000000000 Time: 4.12555 [04/18/2023-13:43:14] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.194825 [04/18/2023-13:43:14] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.194825 [04/18/2023-13:43:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:43:14] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:14] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600,40,1) -> Int8(409600,1600,40,1) long-strided *************** [04/18/2023-13:43:14] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:14] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:14] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:14] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-13:43:14] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:14] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:14] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:14] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:4,40,1) -> Int8(102400,1600:4,40,1) long-strided *************** [04/18/2023-13:43:14] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:43:14] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:14] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:43:14] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:14] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:14] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:4,40,1) -> Int8(12800,1600:32,40,1) long-strided *************** [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:4,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:43:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:43:15] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] *************** Autotuning format combination: Int8(3200,1600:32,40,1) -> Int8(12800,1600:32,40,1) long-strided *************** [04/18/2023-13:43:15] [V] [TRT] *************** Autotuning format combination: Int8(3200,1600:32,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-13:43:15] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:15] [V] [TRT] *************** Autotuning format combination: Int8(409600,1600,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:43:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:43:15] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-13:43:15] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:15] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Float(204800,400,20,1) long-strided *************** [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:43:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 Tactic: 0x127de12a1f1a4809 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x127de12a1f1a4809 Time: 0.0507611 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0498834 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.0357303 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.0393109 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0364617 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.0498834 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0316754 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 Tactic: 0x1b0534177b414e71 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x1b0534177b414e71 Time: 0.0339383 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.0329435 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0420537 [04/18/2023-13:43:15] [V] [TRT] Fastest Tactic: 0x4d9d0d03129bceb1 Time: 0.0316754 [04/18/2023-13:43:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4d9d0d03129bceb1 [04/18/2023-13:43:15] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Float(102400,400,20,1) *************** [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:43:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 Tactic: 0x127de12a1f1a4809 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x127de12a1f1a4809 Time: 0.0507611 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0497371 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.0357246 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.0393463 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0365714 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.0502644 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0313911 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 Tactic: 0x1b0534177b414e71 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x1b0534177b414e71 Time: 0.0337335 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.032907 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0421211 [04/18/2023-13:43:15] [V] [TRT] Fastest Tactic: 0x4d9d0d03129bceb1 Time: 0.0313911 [04/18/2023-13:43:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4d9d0d03129bceb1 [04/18/2023-13:43:15] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Float(204800,400,20,1) long-strided *************** [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x2bcbba39f608bf10 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x2bcbba39f608bf10 Time: 0.0139695 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x85c1a5f7f239cf84 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x85c1a5f7f239cf84 Time: 0.0104689 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0xac914b235d066808 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xac914b235d066808 Time: 0.0205218 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0xa8b56a226b057463 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xa8b56a226b057463 Time: 0.011309 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x64x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x23b890da05937b9e [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x23b890da05937b9e Time: 0.0132804 [04/18/2023-13:43:15] [V] [TRT] Fastest Tactic: 0x85c1a5f7f239cf84 Time: 0.0104689 [04/18/2023-13:43:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x85c1a5f7f239cf84 [04/18/2023-13:43:15] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Float(6400,400:32,20,1) long-strided *************** [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskJitConv) [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3d41ef6de22d9b6 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xd3d41ef6de22d9b6 Time: 0.0170667 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0302912 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00725509 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.010654 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xf8d4389f60adfa3c [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xf8d4389f60adfa3c Time: 0.0300471 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00711554 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2f34f689bfca5071 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x2f34f689bfca5071 Time: 0.00703565 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x554e2e252e28b3fd [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x554e2e252e28b3fd Time: 0.0295771 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0298368 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x4749124f62d8bd23 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x4749124f62d8bd23 Time: 0.0069908 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3f592fae61c7986 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xd3f592fae61c7986 Time: 0.00660883 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0172825 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.0104392 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xbb88763c3b0e94d4 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xbb88763c3b0e94d4 Time: 0.00775844 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea88b51105501f96 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xea88b51105501f96 Time: 0.0166425 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd30e9f770878c3fd [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xd30e9f770878c3fd Time: 0.0099648 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x53554c607d072468 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x53554c607d072468 Time: 0.0109371 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00808051 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.0112644 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00686716 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.0167848 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x705baf38e41eee0b [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x705baf38e41eee0b Time: 0.0101623 [04/18/2023-13:43:15] [V] [TRT] Fastest Tactic: 0xd3f592fae61c7986 Time: 0.00660883 [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x45f7566cdb2b10fb [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x45f7566cdb2b10fb Time: 0.00881748 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.0167091 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea2b7420057a01c1 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xea2b7420057a01c1 Time: 0.0318025 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.0108111 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2d8ab2aa0639fda9 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x2d8ab2aa0639fda9 Time: 0.00979139 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd14bd6d95fefd45e [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xd14bd6d95fefd45e Time: 0.00924914 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.00895286 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.0126655 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.0124244 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x0e07dc8353bf7e9f [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x0e07dc8353bf7e9f Time: 0.0190326 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x55edef142e02adaa [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x55edef142e02adaa Time: 0.0187063 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0318903 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.0192669 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x0edd5d0285e564d4 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x0edd5d0285e564d4 Time: 0.0122575 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xb936321f82fd390c [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xb936321f82fd390c Time: 0.00897171 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.00942486 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.00943657 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xad886d4d69834922 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xad886d4d69834922 Time: 0.0122503 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0326217 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x47b1629a4bff4800 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x47b1629a4bff4800 Time: 0.0320366 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.0103967 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.0195583 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.0214413 [04/18/2023-13:43:15] [V] [TRT] Fastest Tactic: 0x45f7566cdb2b10fb Time: 0.00881748 [04/18/2023-13:43:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0xd3f592fae61c7986 [04/18/2023-13:43:15] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Half(6400,400:32,20,1) long-strided *************** [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskJitConv) [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3d41ef6de22d9b6 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xd3d41ef6de22d9b6 Time: 0.0152293 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0264038 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00725143 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.00980937 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xf8d4389f60adfa3c [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xf8d4389f60adfa3c Time: 0.0261829 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00700103 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2f34f689bfca5071 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x2f34f689bfca5071 Time: 0.00694139 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x554e2e252e28b3fd [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x554e2e252e28b3fd Time: 0.0257539 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0259413 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x4749124f62d8bd23 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x4749124f62d8bd23 Time: 0.00681731 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3f592fae61c7986 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xd3f592fae61c7986 Time: 0.00619295 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0154994 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00958293 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xbb88763c3b0e94d4 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xbb88763c3b0e94d4 Time: 0.00739154 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea88b51105501f96 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xea88b51105501f96 Time: 0.0149093 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd30e9f770878c3fd [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xd30e9f770878c3fd Time: 0.00926343 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x53554c607d072468 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x53554c607d072468 Time: 0.0102054 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00781738 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.0104878 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00645645 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.0151259 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x705baf38e41eee0b [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x705baf38e41eee0b Time: 0.00952991 [04/18/2023-13:43:15] [V] [TRT] Fastest Tactic: 0xd3f592fae61c7986 Time: 0.00619295 [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0xd3f592fae61c7986 [04/18/2023-13:43:15] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Float(102400,400,20,1) *************** [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x2bcbba39f608bf10 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x2bcbba39f608bf10 Time: 0.0137725 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x85c1a5f7f239cf84 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x85c1a5f7f239cf84 Time: 0.0103507 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0xac914b235d066808 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xac914b235d066808 Time: 0.0204532 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0xa8b56a226b057463 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xa8b56a226b057463 Time: 0.0111708 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x64x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x23b890da05937b9e [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x23b890da05937b9e Time: 0.0130992 [04/18/2023-13:43:15] [V] [TRT] Fastest Tactic: 0x85c1a5f7f239cf84 Time: 0.0103507 [04/18/2023-13:43:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x85c1a5f7f239cf84 [04/18/2023-13:43:15] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskJitConv) [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3d41ef6de22d9b6 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xd3d41ef6de22d9b6 Time: 0.0170667 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.030283 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.0072416 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.0106459 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xf8d4389f60adfa3c [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xf8d4389f60adfa3c Time: 0.0301349 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00702542 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2f34f689bfca5071 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x2f34f689bfca5071 Time: 0.00700082 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x554e2e252e28b3fd [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x554e2e252e28b3fd Time: 0.0295872 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0298194 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x4749124f62d8bd23 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x4749124f62d8bd23 Time: 0.00695467 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3f592fae61c7986 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xd3f592fae61c7986 Time: 0.00661839 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0173161 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.0104307 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xbb88763c3b0e94d4 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xbb88763c3b0e94d4 Time: 0.00785997 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea88b51105501f96 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xea88b51105501f96 Time: 0.0165933 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd30e9f770878c3fd [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xd30e9f770878c3fd Time: 0.0100386 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x53554c607d072468 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x53554c607d072468 Time: 0.0109401 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00806756 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.0112271 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00685431 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.0167787 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x705baf38e41eee0b [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x705baf38e41eee0b Time: 0.0101406 [04/18/2023-13:43:15] [V] [TRT] Fastest Tactic: 0xd3f592fae61c7986 Time: 0.00661839 [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x45f7566cdb2b10fb [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x45f7566cdb2b10fb Time: 0.00875133 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.016798 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea2b7420057a01c1 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xea2b7420057a01c1 Time: 0.0320064 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.0106988 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2d8ab2aa0639fda9 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x2d8ab2aa0639fda9 Time: 0.00968747 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd14bd6d95fefd45e [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xd14bd6d95fefd45e Time: 0.00914943 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.00889761 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.0125539 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.0123303 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x0e07dc8353bf7e9f [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x0e07dc8353bf7e9f Time: 0.0189446 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x55edef142e02adaa [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x55edef142e02adaa Time: 0.0186063 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0318546 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.0191343 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x0edd5d0285e564d4 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x0edd5d0285e564d4 Time: 0.0121547 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xb936321f82fd390c [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xb936321f82fd390c Time: 0.00890622 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.00934514 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.00932229 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xad886d4d69834922 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xad886d4d69834922 Time: 0.0121779 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0325449 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x47b1629a4bff4800 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x47b1629a4bff4800 Time: 0.0319899 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.0102883 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.0193211 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.0213355 [04/18/2023-13:43:15] [V] [TRT] Fastest Tactic: 0x45f7566cdb2b10fb Time: 0.00875133 [04/18/2023-13:43:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0xd3f592fae61c7986 [04/18/2023-13:43:15] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskJitConv) [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3d41ef6de22d9b6 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xd3d41ef6de22d9b6 Time: 0.015243 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.026384 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00712229 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.00976914 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xf8d4389f60adfa3c [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xf8d4389f60adfa3c Time: 0.0261493 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.0070141 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2f34f689bfca5071 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x2f34f689bfca5071 Time: 0.00696425 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x554e2e252e28b3fd [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x554e2e252e28b3fd Time: 0.025747 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0259413 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x4749124f62d8bd23 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x4749124f62d8bd23 Time: 0.0068615 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3f592fae61c7986 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xd3f592fae61c7986 Time: 0.00617714 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0155063 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00959055 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xbb88763c3b0e94d4 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xbb88763c3b0e94d4 Time: 0.00736914 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea88b51105501f96 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xea88b51105501f96 Time: 0.0148864 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd30e9f770878c3fd [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xd30e9f770878c3fd Time: 0.00932572 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x53554c607d072468 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x53554c607d072468 Time: 0.0102046 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.007808 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.0105051 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00645466 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.0151675 [04/18/2023-13:43:15] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x705baf38e41eee0b [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x705baf38e41eee0b Time: 0.00955154 [04/18/2023-13:43:15] [V] [TRT] Fastest Tactic: 0xd3f592fae61c7986 Time: 0.00617714 [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0xd3f592fae61c7986 [04/18/2023-13:43:15] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:15] [V] [TRT] *************** Autotuning format combination: Int8(204800,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:43:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:43:15] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:43:15] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:43:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:43:15] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.0151813 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0159182 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0131873 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.0147456 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.014848 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.010542 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.0111297 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.00968168 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00984686 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0098499 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0164444 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.00965333 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.00995017 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0166766 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0273059 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0151223 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0107239 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0272823 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0274834 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0121253 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0105381 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0191246 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0277128 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.0122709 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0188234 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0279741 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.027965 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0181714 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0108183 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.0114687 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0157385 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.017152 [04/18/2023-13:43:15] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0166146 [04/18/2023-13:43:15] [V] [TRT] Fastest Tactic: 0xfbcd5a1da537e27f Time: 0.00965333 [04/18/2023-13:43:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xfbcd5a1da537e27f [04/18/2023-13:43:15] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:15] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv (CudaDepthwiseConvolution) [04/18/2023-13:43:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv (CaskFlattenConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv (CaskConvolution) [04/18/2023-13:43:15] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 0xc25454de2efcccdc [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xc25454de2efcccdc Time: 0.012173 [04/18/2023-13:43:15] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: 0xff6944b17d5b2e32 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xff6944b17d5b2e32 Time: 0.0118379 [04/18/2023-13:43:15] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.016607 [04/18/2023-13:43:15] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.0126629 [04/18/2023-13:43:15] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.0141153 [04/18/2023-13:43:15] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0130207 [04/18/2023-13:43:15] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.0166314 [04/18/2023-13:43:15] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0123017 [04/18/2023-13:43:15] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 0x1db6e8cf1382fbe0 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x1db6e8cf1382fbe0 Time: 0.0164587 [04/18/2023-13:43:15] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: 0xa4ae2d82115c3e83 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xa4ae2d82115c3e83 Time: 0.0134092 [04/18/2023-13:43:15] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.0123581 [04/18/2023-13:43:15] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.014539 [04/18/2023-13:43:15] [V] [TRT] Fastest Tactic: 0xff6944b17d5b2e32 Time: 0.0118379 [04/18/2023-13:43:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xff6944b17d5b2e32 [04/18/2023-13:43:15] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv (CaskFlattenConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv (CaskConvolution) [04/18/2023-13:43:15] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x733ba2a91a48d431 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x733ba2a91a48d431 Time: 0.00776229 [04/18/2023-13:43:15] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0xf04572b287451f42 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xf04572b287451f42 Time: 0.00837613 [04/18/2023-13:43:15] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x5e4f6d7c83746fd6 Time: 0.00990476 [04/18/2023-13:43:15] [V] [TRT] Fastest Tactic: 0x733ba2a91a48d431 Time: 0.00776229 [04/18/2023-13:43:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x733ba2a91a48d431 [04/18/2023-13:43:15] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv (CaskFlattenConvolution) [04/18/2023-13:43:15] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:15] [V] [TRT] --------------- Timing Runner: model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv (CaskConvolution) [04/18/2023-13:43:15] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa71946688cad8664 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xa71946688cad8664 Time: 0.00739863 [04/18/2023-13:43:15] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x1e55f8b415964e81 [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x1e55f8b415964e81 Time: 0.00912972 [04/18/2023-13:43:15] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-13:43:15] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.00904314 [04/18/2023-13:43:15] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9003f5f7ff9b1aec [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x9003f5f7ff9b1aec Time: 0.0139857 [04/18/2023-13:43:15] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9ec201b34455146e [04/18/2023-13:43:15] [V] [TRT] Tactic: 0x9ec201b34455146e Time: 0.00782532 [04/18/2023-13:43:15] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x91930a570b557437 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x91930a570b557437 Time: 0.0141847 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdf7e1bd6a496d667 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xdf7e1bd6a496d667 Time: 0.00917972 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6d377e4222886190 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x6d377e4222886190 Time: 0.00852302 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x271b998fe31732ef [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x271b998fe31732ef Time: 0.00770141 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.00843187 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x960e9baa2a6cad5b [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x960e9baa2a6cad5b Time: 0.00775675 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.00856497 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x84942841d92b0552 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x84942841d92b0552 Time: 0.00940657 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xbeb5d91e1874a437 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xbeb5d91e1874a437 Time: 0.009068 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcd229658c16b33cd [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xcd229658c16b33cd Time: 0.0144567 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.00776229 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.00794032 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x33a5c6dd086942c1 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x33a5c6dd086942c1 Time: 0.00797359 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7720f198395e7d3d [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x7720f198395e7d3d Time: 0.00744754 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0146309 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.00921057 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x60b880e28fee7a0c [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x60b880e28fee7a0c Time: 0.0145783 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcf64a2ae51bf6b36 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xcf64a2ae51bf6b36 Time: 0.00870185 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x844ea9c00f711f19 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x844ea9c00f711f19 Time: 0.00764896 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x65fbe45b4cb1d8a5 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x65fbe45b4cb1d8a5 Time: 0.00855718 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.00820368 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.00845956 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5bd8221bd57baf93 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x5bd8221bd57baf93 Time: 0.00857627 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0148965 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.00747977 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.00967619 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6e9c17a33c93d9b0 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x6e9c17a33c93d9b0 Time: 0.00747406 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.00983863 [04/18/2023-13:43:16] [V] [TRT] Fastest Tactic: 0xa71946688cad8664 Time: 0.00739863 [04/18/2023-13:43:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa71946688cad8664 [04/18/2023-13:43:16] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv (CaskFlattenConvolution) [04/18/2023-13:43:16] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv (CaskConvolution) [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5812ced7874b44d1 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x5812ced7874b44d1 Time: 0.00584448 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x43e3804f158e597d [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x43e3804f158e597d Time: 0.00716663 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7524377e24bc511f [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x7524377e24bc511f Time: 0.00806045 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x264d83735b1cba13 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x264d83735b1cba13 Time: 0.0075152 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3e116db8858d0d41 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x3e116db8858d0d41 Time: 0.006048 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x758f8b2079a95b2e [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x758f8b2079a95b2e Time: 0.00559226 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7de8ad674a85e82a [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x7de8ad674a85e82a Time: 0.00778779 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x8f07802f58d278c0 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x8f07802f58d278c0 Time: 0.0105058 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x1cfa820c55616892 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x1cfa820c55616892 Time: 0.00685148 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xccdb99df0646c7b3 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xccdb99df0646c7b3 Time: 0.00805384 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcf392eca056b8d88 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xcf392eca056b8d88 Time: 0.0106237 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x4f8662a723b489e1 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x4f8662a723b489e1 Time: 0.00794286 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x8e1dd2962c589dd4 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x8e1dd2962c589dd4 Time: 0.00580992 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xaba07efc49c11a6c [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xaba07efc49c11a6c Time: 0.0101586 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xd7985d83133bcf37 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xd7985d83133bcf37 Time: 0.00777889 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xb34706d47a62a016 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xb34706d47a62a016 Time: 0.00793981 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x8486adb55ae0ca6c [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x8486adb55ae0ca6c Time: 0.00680686 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x86d1488f426124e1 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x86d1488f426124e1 Time: 0.00755416 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcba01f45d37a76a0 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xcba01f45d37a76a0 Time: 0.00579785 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x62a338704beec449 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x62a338704beec449 Time: 0.0103389 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x68f52f0a3f1c5b56 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x68f52f0a3f1c5b56 Time: 0.00583132 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdb3ae212a7704d44 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xdb3ae212a7704d44 Time: 0.00829359 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x4e7f02f91ddf4673 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x4e7f02f91ddf4673 Time: 0.0107135 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xaceaca2c82ab40f3 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xaceaca2c82ab40f3 Time: 0.00844235 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xaa30815cbd0f74b7 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xaa30815cbd0f74b7 Time: 0.0100264 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6c336d1b7c64ffa3 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x6c336d1b7c64ffa3 Time: 0.00568264 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb7a90e7097d64877 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xb7a90e7097d64877 Time: 0.00643438 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x682fae8be946411d [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x682fae8be946411d Time: 0.00712359 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x70ffb5fe2e1321e3 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x70ffb5fe2e1321e3 Time: 0.00695837 [04/18/2023-13:43:16] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x27fb8661fea664b3 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x27fb8661fea664b3 Time: 0.0059661 [04/18/2023-13:43:16] [V] [TRT] Fastest Tactic: 0x758f8b2079a95b2e Time: 0.00559226 [04/18/2023-13:43:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x758f8b2079a95b2e [04/18/2023-13:43:16] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:16] [V] [TRT] *************** Autotuning format combination: Int8(204800,400,20,1) -> Int8(204800,400,20,1) long-strided *************** [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:16] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] *************** Autotuning format combination: Int8(204800,400,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:16] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(51200,400:4,20,1) long-strided *************** [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:43:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:43:16] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:16] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(6400,400:32,20,1) long-strided *************** [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:16] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:43:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:43:16] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:16] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:16] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Int8(6400,400:32,20,1) long-strided *************** [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:43:16] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:43:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:43:16] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:16] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00442126 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00454214 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00463867 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00494156 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0053804 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00478507 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00515526 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00555218 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00677984 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00690721 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00675075 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00703042 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0159259 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00676966 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00704566 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.0106511 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00485379 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.0107259 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.0105244 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0109303 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0159609 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00527526 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00450186 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00593646 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00744206 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0160081 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0078246 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00690699 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0122042 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0170017 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00676904 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00509367 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00700996 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00465475 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0166766 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0163048 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0116469 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00711924 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.005648 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00527657 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0163124 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0160914 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0115341 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.0109737 [04/18/2023-13:43:16] [V] [TRT] Fastest Tactic: 0xeb1602207b0c3d49 Time: 0.00442126 [04/18/2023-13:43:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:43:16] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:43:16] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:43:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:43:16] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:16] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00441822 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00452814 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00465047 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00494014 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00527559 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00477836 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00516245 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00554549 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00670774 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00693355 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00673932 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00702955 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.015627 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00674369 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00703695 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.0106648 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00484343 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.0107533 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.0104771 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0108353 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.015851 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00515706 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00451443 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00586149 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00739268 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0159873 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00784986 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00690438 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0122941 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0170235 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00676156 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00508642 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00691461 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.004587 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0167939 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0162702 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0117447 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00713752 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00567947 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00528588 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0162905 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0160731 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0116093 [04/18/2023-13:43:16] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-13:43:16] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.0109897 [04/18/2023-13:43:16] [V] [TRT] Fastest Tactic: 0xeb1602207b0c3d49 Time: 0.00441822 [04/18/2023-13:43:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:43:16] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:16] [V] [TRT] *************** Autotuning format combination: Int8(204800,400,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:16] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:43:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:43:16] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:16] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:16] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-13:43:16] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:16] [V] [TRT] *************** Autotuning format combination: Float(408000,1600,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00446886 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00374658 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.003596 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00373533 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00342139 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00333937 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00373873 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00333108 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0033819 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00319279 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00443387 [04/18/2023-13:43:16] [V] [TRT] Fastest Tactic: 0x0000000000000009 Time: 0.00319279 [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWise) [04/18/2023-13:43:16] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000009 [04/18/2023-13:43:16] [V] [TRT] *************** Autotuning format combination: Float(408000,1600,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00446529 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00374353 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0034548 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00373298 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00332874 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00300562 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00357129 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00312288 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00308708 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00316005 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00445825 [04/18/2023-13:43:16] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.00300562 [04/18/2023-13:43:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [04/18/2023-13:43:16] [V] [TRT] *************** Autotuning format combination: Float(408000,1,10200,255) -> Float(408000,1,10200,255) *************** [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00446629 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00375478 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0034535 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00374236 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00342748 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00334512 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00374213 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0033264 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00336776 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00317785 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00441794 [04/18/2023-13:43:16] [V] [TRT] Fastest Tactic: 0x0000000000000009 Time: 0.00317785 [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWise) [04/18/2023-13:43:16] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000009 [04/18/2023-13:43:16] [V] [TRT] *************** Autotuning format combination: Float(102400,1:4,2560,64) -> Float(102400,1:4,2560,64) *************** [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00336957 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00345089 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.003665 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00354542 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00379537 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00422198 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00374306 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00426205 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00461552 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00566506 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00408076 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00388139 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00347897 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00385636 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00361406 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0035968 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00428383 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00373287 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00378719 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00418808 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00537295 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00461714 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00418077 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00418312 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00339976 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00403124 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00534248 [04/18/2023-13:43:16] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00336957 [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWise) [04/18/2023-13:43:16] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [04/18/2023-13:43:16] [V] [TRT] *************** Autotuning format combination: Float(12800,1600:32,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00380656 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00375103 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00426178 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00569723 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00381594 [04/18/2023-13:43:16] [V] [TRT] Fastest Tactic: 0x0000000000000019 Time: 0.00375103 [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWise) [04/18/2023-13:43:16] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000019 [04/18/2023-13:43:16] [V] [TRT] *************** Autotuning format combination: Float(12800,1600:32,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00375256 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00416 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00520196 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00760204 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00374142 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00360377 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00409992 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00543864 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00365246 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00374482 [04/18/2023-13:43:16] [V] [TRT] Fastest Tactic: 0x0000000000000019 Time: 0.00360377 [04/18/2023-13:43:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000019 [04/18/2023-13:43:16] [V] [TRT] *************** Autotuning format combination: Float(1:4,1600,40,1) -> Float(1:4,1600,40,1) *************** [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0217365 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x000000000000001d Time: 0.022127 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0219638 [04/18/2023-13:43:16] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.0217365 [04/18/2023-13:43:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-13:43:16] [V] [TRT] *************** Autotuning format combination: Half(408000,1600,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00444357 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00375561 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00348452 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00373966 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00340365 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00330005 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00371013 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00328093 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00319136 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00319492 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00431005 [04/18/2023-13:43:16] [V] [TRT] Fastest Tactic: 0x0000000000000008 Time: 0.00319136 [04/18/2023-13:43:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000008 [04/18/2023-13:43:16] [V] [TRT] *************** Autotuning format combination: Half(408000,1600,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-13:43:16] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00444925 [04/18/2023-13:43:16] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00374236 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00343652 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00371657 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00329922 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00298809 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00357531 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00310748 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00299095 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00285517 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00440035 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x0000000000000009 Time: 0.00285517 [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWise) [04/18/2023-13:43:17] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000009 [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Half(204800,1600:2,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00438151 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00385504 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00358971 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00370661 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00357166 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00320813 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00419566 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00358743 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00344588 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00356293 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0063833 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00510596 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00459514 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00447557 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00401625 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00357062 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00430628 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00371071 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00334065 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00326462 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00433704 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0062551 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.00320813 [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWise) [04/18/2023-13:43:17] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Half(51200,1:8,1280,32) -> Half(51200,1:8,1280,32) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00306801 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0031355 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00349101 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00332258 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00386644 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00345415 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00357829 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00444135 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00387707 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00438663 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00340952 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0034265 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00314474 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00394168 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00342182 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00326442 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00520049 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00387595 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00361257 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00347222 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00405511 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00385889 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0037229 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.004468 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00541579 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00472199 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00430776 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00420343 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00304836 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00339551 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00398171 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00533333 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00304836 [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWise) [04/18/2023-13:43:17] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Half(25600,1:16,640,16) -> Half(25600,1:16,640,16) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00322783 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000000b Time: 0.003596 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00354018 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00466684 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00390758 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00345284 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00653506 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0046226 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00401892 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00445825 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00340061 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00344033 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00395107 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00518922 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.004048 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00384842 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00372243 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00445936 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00326088 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0033835 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00408038 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x000000000000000a Time: 0.00322783 [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWise) [04/18/2023-13:43:17] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000000a [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Half(12800,1600:32,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0038228 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00397105 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00399378 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00493415 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00376962 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00376962 [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Half(12800,1600:32,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00337924 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0035768 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0041613 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00563464 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00356951 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00356839 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00368832 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001b Time: 0.004515 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00334958 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0035685 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.00334958 [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWise) [04/18/2023-13:43:17] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Half(1:8,1600,40,1) -> Half(1:8,1600,40,1) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0261181 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0225979 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0228833 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0322414 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.0225979 [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Half(408000:32,1600,40,1) -> Half(408000:32,1600,40,1) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0980571 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0966217 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0979383 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0965349 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0833829 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0850651 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0865966 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0857166 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0975794 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0830171 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.0830171 [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:43:17] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Float(408000,1600,40,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_2 + /model.77/Transpose_1 (Shuffle) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00791483 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0132854 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00791483 [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Float(408000,1,10200,255) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_2 + /model.77/Transpose_1 (Shuffle) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0219429 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0136985 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0136985 [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Float(102400,1:4,2560,64) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_2 + /model.77/Transpose_1 (Shuffle) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0217162 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0162966 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0162966 [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Float(12800,1600:32,40,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_2 + /model.77/Transpose_1 (Shuffle) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0543208 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0166491 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0166491 [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Half(408000,1600,40,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_2 + /model.77/Transpose_1 (Shuffle) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0073184 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0199491 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0073184 [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Half(204800,1600:2,40,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_2 + /model.77/Transpose_1 (Shuffle) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0077582 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0268 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0077582 [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Half(102400,1:4,2560,64) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_2 + /model.77/Transpose_1 (Shuffle) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0211958 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.020721 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.020721 [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Half(51200,1:8,1280,32) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_2 + /model.77/Transpose_1 (Shuffle) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0214204 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0167741 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0167741 [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Half(25600,1:16,640,16) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_2 + /model.77/Transpose_1 (Shuffle) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0269173 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0164551 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0164551 [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Half(12800,1600:32,40,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_2 + /model.77/Transpose_1 (Shuffle) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0266728 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0177656 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0177656 [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:43:17] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Float(408000,136000,3400,85,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Split_1 (Slice) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245315 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00245315 [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Split_1 (Padding) [04/18/2023-13:43:17] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Half(408000,136000,3400,85,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Split_1 (Slice) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238074 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238074 [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Split_1 (Padding) [04/18/2023-13:43:17] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Half(204000,68000,3400:2,85,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Split_1 (Padding) [04/18/2023-13:43:17] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Half(51000,17000,1:8,425,5) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Split_1 (Padding) [04/18/2023-13:43:17] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Float(408000,136000,3400,85,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_116 (Slice) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238324 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238324 [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_116 (Padding) [04/18/2023-13:43:17] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Half(408000,136000,3400,85,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_116 (Slice) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236545 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236545 [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_116 (Padding) [04/18/2023-13:43:17] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Half(204000,68000,3400:2,85,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_116 (Padding) [04/18/2023-13:43:17] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Half(51000,17000,1:8,425,5) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_116 (Padding) [04/18/2023-13:43:17] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Float(408000,136000,3400,85,1) -> Float(408000,136000,3400,85,1) long-strided *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_117 (Slice) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00441835 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00441835 [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_117 (Padding) [04/18/2023-13:43:17] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Float(408000,136000,3400,85,1) -> Float(388800,129600,3240,81,1) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_117 (Slice) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0043973 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0043973 [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_117 (Padding) [04/18/2023-13:43:17] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Half(408000,136000,3400,85,1) -> Half(408000,136000,3400,85,1) long-strided *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_117 (Slice) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00438649 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00438649 [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_117 (Padding) [04/18/2023-13:43:17] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Half(408000,136000,3400,85,1) -> Half(388800,129600,3240,81,1) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_117 (Slice) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00439924 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00439924 [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_117 (Padding) [04/18/2023-13:43:17] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Half(204000,68000,3400:2,85,1) -> Half(204000,68000,3400:2,85,1) long-strided *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_117 (Padding) [04/18/2023-13:43:17] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Half(204000,68000,3400:2,85,1) -> Half(194400,64800,3240:2,81,1) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_117 (Padding) [04/18/2023-13:43:17] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Half(51000,17000,1:8,425,5) -> Half(51000,17000,1:8,425,5) long-strided *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_117 (Padding) [04/18/2023-13:43:17] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Half(51000,17000,1:8,425,5) -> Half(48600,16200,1:8,405,5) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_117 (Padding) [04/18/2023-13:43:17] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Int8(51200,400,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:17] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Int8(12800,400:4,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:43:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:43:17] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:17] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Int8(12800,400:4,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:17] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Int8(1600,400:32,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:43:17] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:43:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:43:17] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:17] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.00571833 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00589934 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00710095 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.00580718 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00612438 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.00700582 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00732708 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-13:43:17] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.00923972 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00942429 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00981303 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.016318 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-13:43:17] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.00941343 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-13:43:17] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.0096387 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.016642 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0273798 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00851308 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.010543 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0270446 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0272389 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:43:17] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0119661 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0103941 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0190577 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0277699 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.00661818 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00701997 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0280869 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0277928 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0180977 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0107161 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00791194 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00734834 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0172094 [04/18/2023-13:43:17] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0166476 [04/18/2023-13:43:17] [V] [TRT] Fastest Tactic: 0x7ddd3b3f55023bab Time: 0.00571833 [04/18/2023-13:43:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x7ddd3b3f55023bab [04/18/2023-13:43:17] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:17] [V] [TRT] *************** Autotuning format combination: Float(9600,3200,80,2,1), Float(3200,3200,80,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:43:17] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242968 [04/18/2023-13:43:17] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00254589 [04/18/2023-13:43:18] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00238453 [04/18/2023-13:43:18] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00282604 [04/18/2023-13:43:18] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00262051 [04/18/2023-13:43:18] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00245904 [04/18/2023-13:43:18] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00347897 [04/18/2023-13:43:18] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00300905 [04/18/2023-13:43:19] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00268631 [04/18/2023-13:43:19] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00300181 [04/18/2023-13:43:19] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00254685 [04/18/2023-13:43:19] [V] [TRT] Fastest Tactic: 0x0000000000000002 Time: 0.00238453 [04/18/2023-13:43:19] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWise) [04/18/2023-13:43:19] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 [04/18/2023-13:43:19] [V] [TRT] *************** Autotuning format combination: Float(9600,3200,80,2,1), Float(3200,3200,80,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:43:19] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-13:43:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00262284 [04/18/2023-13:43:19] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00280578 [04/18/2023-13:43:19] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00272518 [04/18/2023-13:43:20] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00311404 [04/18/2023-13:43:20] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00285952 [04/18/2023-13:43:20] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00281824 [04/18/2023-13:43:20] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00387484 [04/18/2023-13:43:20] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00333417 [04/18/2023-13:43:20] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00307696 [04/18/2023-13:43:21] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00302476 [04/18/2023-13:43:21] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00258008 [04/18/2023-13:43:21] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00258008 [04/18/2023-13:43:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-13:43:21] [V] [TRT] *************** Autotuning format combination: Float(9600,3200,1,80,40), Float(3200,3200,1,80,40) -> Float(9600,3200,1,80,40) *************** [04/18/2023-13:43:21] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-13:43:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247504 [04/18/2023-13:43:21] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00264337 [04/18/2023-13:43:21] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00245749 [04/18/2023-13:43:21] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00300219 [04/18/2023-13:43:21] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00279297 [04/18/2023-13:43:21] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00263414 [04/18/2023-13:43:21] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00379176 [04/18/2023-13:43:21] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00318517 [04/18/2023-13:43:21] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00281896 [04/18/2023-13:43:21] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00292142 [04/18/2023-13:43:21] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00246113 [04/18/2023-13:43:21] [V] [TRT] Fastest Tactic: 0x0000000000000002 Time: 0.00245749 [04/18/2023-13:43:21] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWise) [04/18/2023-13:43:21] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 [04/18/2023-13:43:21] [V] [TRT] *************** Autotuning format combination: Float(2400,800,1:4,20,10), Float(800,800,1:4,20,10) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-13:43:21] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-13:43:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00274476 [04/18/2023-13:43:21] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00308153 [04/18/2023-13:43:21] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00375361 [04/18/2023-13:43:22] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0038258 [04/18/2023-13:43:22] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00374494 [04/18/2023-13:43:22] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00379356 [04/18/2023-13:43:22] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00516571 [04/18/2023-13:43:22] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00500855 [04/18/2023-13:43:22] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00503567 [04/18/2023-13:43:23] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00514694 [04/18/2023-13:43:23] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00273751 [04/18/2023-13:43:23] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00299524 [04/18/2023-13:43:23] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00302571 [04/18/2023-13:43:23] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00336744 [04/18/2023-13:43:24] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00353238 [04/18/2023-13:43:24] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00382063 [04/18/2023-13:43:24] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00425318 [04/18/2023-13:43:24] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00469928 [04/18/2023-13:43:24] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00511935 [04/18/2023-13:43:24] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0063203 [04/18/2023-13:43:25] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00255306 [04/18/2023-13:43:25] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00271146 [04/18/2023-13:43:25] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00314027 [04/18/2023-13:43:25] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0038767 [04/18/2023-13:43:25] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00283196 [04/18/2023-13:43:25] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00271 [04/18/2023-13:43:26] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00264567 [04/18/2023-13:43:26] [V] [TRT] Fastest Tactic: 0x0000000000000014 Time: 0.00255306 [04/18/2023-13:43:26] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWise) [04/18/2023-13:43:26] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000014 [04/18/2023-13:43:26] [V] [TRT] *************** Autotuning format combination: Float(480,160,80:32,2,1), Float(160,160,80:32,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:43:26] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-13:43:26] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00293411 [04/18/2023-13:43:26] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00374869 [04/18/2023-13:43:26] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00502132 [04/18/2023-13:43:26] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00745211 [04/18/2023-13:43:26] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00290213 [04/18/2023-13:43:26] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00290213 [04/18/2023-13:43:26] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWise) [04/18/2023-13:43:26] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:43:26] [V] [TRT] *************** Autotuning format combination: Float(480,160,80:32,2,1), Float(160,160,80:32,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:43:26] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-13:43:27] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00335192 [04/18/2023-13:43:27] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0056327 [04/18/2023-13:43:27] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00833702 [04/18/2023-13:43:27] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0138739 [04/18/2023-13:43:27] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00284997 [04/18/2023-13:43:28] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00353227 [04/18/2023-13:43:28] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00460729 [04/18/2023-13:43:28] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00676634 [04/18/2023-13:43:28] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00339817 [04/18/2023-13:43:28] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00288978 [04/18/2023-13:43:28] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.00284997 [04/18/2023-13:43:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-13:43:28] [V] [TRT] *************** Autotuning format combination: Float(3200,1:4,80,2,1), Float(3200,1:4,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:43:28] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-13:43:28] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00277029 [04/18/2023-13:43:29] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00269147 [04/18/2023-13:43:29] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00283187 [04/18/2023-13:43:29] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.00269147 [04/18/2023-13:43:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [04/18/2023-13:43:29] [V] [TRT] *************** Autotuning format combination: Half(9600,3200,80,2,1), Half(3200,3200,80,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:43:29] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-13:43:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266641 [04/18/2023-13:43:29] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00276791 [04/18/2023-13:43:29] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00256792 [04/18/2023-13:43:29] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00311245 [04/18/2023-13:43:30] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00295091 [04/18/2023-13:43:30] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00279596 [04/18/2023-13:43:30] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00384734 [04/18/2023-13:43:30] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0034004 [04/18/2023-13:43:30] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00304301 [04/18/2023-13:43:31] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00284818 [04/18/2023-13:43:31] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00254733 [04/18/2023-13:43:31] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00254733 [04/18/2023-13:43:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-13:43:31] [V] [TRT] *************** Autotuning format combination: Half(9600,3200,80,2,1), Half(3200,3200,80,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:43:31] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-13:43:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00262026 [04/18/2023-13:43:31] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00277108 [04/18/2023-13:43:31] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00266836 [04/18/2023-13:43:31] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00334671 [04/18/2023-13:43:32] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00289509 [04/18/2023-13:43:32] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00269046 [04/18/2023-13:43:32] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00385889 [04/18/2023-13:43:32] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00337318 [04/18/2023-13:43:32] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00302543 [04/18/2023-13:43:32] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00290432 [04/18/2023-13:43:33] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00253891 [04/18/2023-13:43:33] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00253891 [04/18/2023-13:43:33] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWise) [04/18/2023-13:43:33] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-13:43:33] [V] [TRT] *************** Autotuning format combination: Half(4800,1600,80:2,2,1), Half(1600,1600,80:2,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:43:33] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-13:43:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00275772 [04/18/2023-13:43:33] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00289746 [04/18/2023-13:43:33] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00285724 [04/18/2023-13:43:33] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00332853 [04/18/2023-13:43:33] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00335054 [04/18/2023-13:43:34] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00336106 [04/18/2023-13:43:34] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00436502 [04/18/2023-13:43:34] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00435449 [04/18/2023-13:43:34] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00440741 [04/18/2023-13:43:34] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00438331 [04/18/2023-13:43:35] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00267039 [04/18/2023-13:43:35] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00287945 [04/18/2023-13:43:35] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00271991 [04/18/2023-13:43:35] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00322651 [04/18/2023-13:43:35] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00294232 [04/18/2023-13:43:35] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0027401 [04/18/2023-13:43:36] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00398755 [04/18/2023-13:43:36] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00351097 [04/18/2023-13:43:36] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00326275 [04/18/2023-13:43:36] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00315279 [04/18/2023-13:43:36] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00271526 [04/18/2023-13:43:36] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00255257 [04/18/2023-13:43:36] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.00255257 [04/18/2023-13:43:36] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWise) [04/18/2023-13:43:36] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [04/18/2023-13:43:36] [V] [TRT] *************** Autotuning format combination: Half(1200,400,1:8,10,5), Half(400,400,1:8,10,5) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:43:36] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-13:43:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00274338 [04/18/2023-13:43:37] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00310827 [04/18/2023-13:43:37] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00336478 [04/18/2023-13:43:37] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00383808 [04/18/2023-13:43:37] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00433761 [04/18/2023-13:43:38] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00416601 [04/18/2023-13:43:38] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00518041 [04/18/2023-13:43:38] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00627498 [04/18/2023-13:43:38] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00619086 [04/18/2023-13:43:38] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00615695 [04/18/2023-13:43:39] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00274156 [04/18/2023-13:43:39] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00310956 [04/18/2023-13:43:39] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0030792 [04/18/2023-13:43:39] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00359223 [04/18/2023-13:43:39] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00388151 [04/18/2023-13:43:40] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00373474 [04/18/2023-13:43:40] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00478629 [04/18/2023-13:43:40] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00517584 [04/18/2023-13:43:40] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00507649 [04/18/2023-13:43:40] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00516718 [04/18/2023-13:43:40] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00271448 [04/18/2023-13:43:41] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00288869 [04/18/2023-13:43:41] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00355601 [04/18/2023-13:43:41] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00451571 [04/18/2023-13:43:41] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00273294 [04/18/2023-13:43:41] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00287113 [04/18/2023-13:43:42] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00318049 [04/18/2023-13:43:42] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00407797 [04/18/2023-13:43:42] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00277011 [04/18/2023-13:43:42] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0026781 [04/18/2023-13:43:42] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0026417 [04/18/2023-13:43:42] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00267539 [04/18/2023-13:43:42] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.0026417 [04/18/2023-13:43:42] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWise) [04/18/2023-13:43:42] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [04/18/2023-13:43:42] [V] [TRT] *************** Autotuning format combination: Half(720,240,1:16,6,3), Half(240,240,1:16,6,3) -> Half(720,240,1:16,6,3) *************** [04/18/2023-13:43:42] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-13:43:43] [V] [TRT] Tactic: 0x000000000000000a Time: 0.002998 [04/18/2023-13:43:43] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00327844 [04/18/2023-13:43:43] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00336106 [04/18/2023-13:43:43] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00355501 [04/18/2023-13:43:43] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00373544 [04/18/2023-13:43:44] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00340844 [04/18/2023-13:43:44] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00430144 [04/18/2023-13:43:44] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0042318 [04/18/2023-13:43:44] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00381618 [04/18/2023-13:43:44] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00356137 [04/18/2023-13:43:45] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00280363 [04/18/2023-13:43:45] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00306159 [04/18/2023-13:43:45] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00322407 [04/18/2023-13:43:45] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00367015 [04/18/2023-13:43:45] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00273837 [04/18/2023-13:43:46] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00291629 [04/18/2023-13:43:46] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0031523 [04/18/2023-13:43:46] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00358766 [04/18/2023-13:43:46] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0030199 [04/18/2023-13:43:46] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00311274 [04/18/2023-13:43:46] [V] [TRT] Tactic: 0x000000000000001f Time: 0.003065 [04/18/2023-13:43:46] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.00273837 [04/18/2023-13:43:46] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWise) [04/18/2023-13:43:46] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-13:43:46] [V] [TRT] *************** Autotuning format combination: Half(480,160,80:32,2,1), Half(160,160,80:32,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:43:46] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-13:43:47] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00313113 [04/18/2023-13:43:47] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00318547 [04/18/2023-13:43:47] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00362789 [04/18/2023-13:43:47] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00450086 [04/18/2023-13:43:47] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00285015 [04/18/2023-13:43:47] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00285015 [04/18/2023-13:43:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:43:47] [V] [TRT] *************** Autotuning format combination: Half(480,160,80:32,2,1), Half(160,160,80:32,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:43:47] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-13:43:47] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0029232 [04/18/2023-13:43:48] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00364297 [04/18/2023-13:43:48] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00471226 [04/18/2023-13:43:48] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00697295 [04/18/2023-13:43:48] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00274087 [04/18/2023-13:43:48] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00302533 [04/18/2023-13:43:49] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00370262 [04/18/2023-13:43:49] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00490743 [04/18/2023-13:43:49] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00295538 [04/18/2023-13:43:49] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00285861 [04/18/2023-13:43:49] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.00274087 [04/18/2023-13:43:49] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWise) [04/18/2023-13:43:49] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-13:43:49] [V] [TRT] *************** Autotuning format combination: Half(3200,1:8,80,2,1), Half(3200,1:8,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:43:49] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-13:43:49] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00286501 [04/18/2023-13:43:49] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00281914 [04/18/2023-13:43:50] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00291993 [04/18/2023-13:43:50] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00271172 [04/18/2023-13:43:50] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00271172 [04/18/2023-13:43:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:43:50] [V] [TRT] *************** Autotuning format combination: Half(3200,3200:32,80,2,1), Half(3200,3200:32,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:43:50] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-13:43:50] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00332789 [04/18/2023-13:43:50] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00391969 [04/18/2023-13:43:50] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0049024 [04/18/2023-13:43:51] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.007248 [04/18/2023-13:43:51] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00334256 [04/18/2023-13:43:51] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00365726 [04/18/2023-13:43:51] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00434757 [04/18/2023-13:43:51] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00605848 [04/18/2023-13:43:51] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00340452 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00341431 [04/18/2023-13:43:52] [V] [TRT] Fastest Tactic: 0x0000000000000014 Time: 0.00332789 [04/18/2023-13:43:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000014 [04/18/2023-13:43:52] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:52] [V] [TRT] *************** Autotuning format combination: Float(9600,3200,80,2,1), Float(6,2,2,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:43:52] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00447014 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00510171 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00479909 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00552475 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0056596 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0050415 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0064312 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00643578 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00643081 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00609048 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00259216 [04/18/2023-13:43:52] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00259216 [04/18/2023-13:43:52] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWise) [04/18/2023-13:43:52] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-13:43:52] [V] [TRT] *************** Autotuning format combination: Float(9600,3200,80,2,1), Float(6,2,2,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:43:52] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00444758 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00510014 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0047869 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00558822 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00578469 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00509336 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00644452 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00691679 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00654379 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00593006 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00252977 [04/18/2023-13:43:52] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00252977 [04/18/2023-13:43:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-13:43:52] [V] [TRT] *************** Autotuning format combination: Float(9600,3200,1,80,40), Float(6,2,1,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-13:43:52] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00256449 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00279226 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00261461 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00282084 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00265566 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00253658 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00299133 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00287013 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00279605 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0026599 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00248079 [04/18/2023-13:43:52] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00248079 [04/18/2023-13:43:52] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWise) [04/18/2023-13:43:52] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-13:43:52] [V] [TRT] *************** Autotuning format combination: Float(2400,800,1:4,20,10), Float(6,2,1:4,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-13:43:52] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00278005 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00285481 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00328665 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00297115 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00299752 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.002962 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00329569 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0032881 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00311463 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00313759 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00264914 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00267463 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00281035 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00280053 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00293663 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00297049 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00299562 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00315419 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00319015 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00341638 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00260081 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00278681 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00281331 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00298162 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00265549 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00263173 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00249167 [04/18/2023-13:43:52] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.00249167 [04/18/2023-13:43:52] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWise) [04/18/2023-13:43:52] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [04/18/2023-13:43:52] [V] [TRT] *************** Autotuning format combination: Float(480,160,80:32,2,1), Float(6,2,2:32,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:43:52] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00280731 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00318943 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00336914 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00379104 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00279508 [04/18/2023-13:43:52] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00279508 [04/18/2023-13:43:52] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWise) [04/18/2023-13:43:52] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:43:52] [V] [TRT] *************** Autotuning format combination: Float(480,160,80:32,2,1), Float(6,2,2:32,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:43:52] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00328706 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00460171 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00494771 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00544728 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00279736 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0031192 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00328125 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00360857 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00328332 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00279297 [04/18/2023-13:43:52] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00279297 [04/18/2023-13:43:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:43:52] [V] [TRT] *************** Autotuning format combination: Float(3200,1:4,80,2,1), Float(2,1:4,2,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-13:43:52] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00281511 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00269706 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00269792 [04/18/2023-13:43:52] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.00269706 [04/18/2023-13:43:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [04/18/2023-13:43:52] [V] [TRT] *************** Autotuning format combination: Half(9600,3200,80,2,1), Half(6,2,2,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-13:43:52] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0046083 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00515216 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00480366 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00567754 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00580498 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00508311 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00670753 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00692702 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00643359 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00610724 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00260181 [04/18/2023-13:43:52] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00260181 [04/18/2023-13:43:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-13:43:52] [V] [TRT] *************** Autotuning format combination: Half(9600,3200,80,2,1), Half(6,2,2,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-13:43:52] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00463794 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00525208 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00485181 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00575159 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00580535 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00512408 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00676218 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0069268 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00657454 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00595524 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00258327 [04/18/2023-13:43:52] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00258327 [04/18/2023-13:43:52] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWise) [04/18/2023-13:43:52] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-13:43:52] [V] [TRT] *************** Autotuning format combination: Half(4800,1600,80:2,2,1), Half(6,2,2:2,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-13:43:52] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00382063 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00414981 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00398387 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00462334 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0044631 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00397651 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00492252 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00442376 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00406527 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00374213 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00325475 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00354241 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00324216 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00398933 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00372021 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00324769 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00488518 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0043459 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00393847 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00342465 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0025207 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00237797 [04/18/2023-13:43:52] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.00237797 [04/18/2023-13:43:52] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWise) [04/18/2023-13:43:52] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [04/18/2023-13:43:52] [V] [TRT] *************** Autotuning format combination: Half(1200,400,1:8,10,5), Half(6,2,1:8,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-13:43:52] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00279218 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00282631 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00297077 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0029662 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00319004 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00311235 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00339189 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00354174 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00340517 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00326618 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00266269 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00268174 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00272449 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00282568 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0028411 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00281206 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00316243 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00311901 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0030041 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00295566 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00252423 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00264686 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00279974 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00309738 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00238385 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00239627 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00253153 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00281752 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00267835 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00254893 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00250763 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00237857 [04/18/2023-13:43:52] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00237857 [04/18/2023-13:43:52] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWise) [04/18/2023-13:43:52] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:43:52] [V] [TRT] *************** Autotuning format combination: Half(720,240,1:16,6,3), Half(6,2,1:16,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-13:43:52] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00275437 [04/18/2023-13:43:52] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00317755 [04/18/2023-13:43:53] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00327584 [04/18/2023-13:43:53] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00356716 [04/18/2023-13:43:53] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00345252 [04/18/2023-13:43:53] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00317515 [04/18/2023-13:43:53] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00460903 [04/18/2023-13:43:54] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00398108 [04/18/2023-13:43:54] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00387781 [04/18/2023-13:43:54] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00387101 [04/18/2023-13:43:54] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0028726 [04/18/2023-13:43:55] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00314236 [04/18/2023-13:43:55] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00339508 [04/18/2023-13:43:55] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00379296 [04/18/2023-13:43:55] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00294241 [04/18/2023-13:43:55] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00304788 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00321798 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00362069 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00305118 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00295202 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00278506 [04/18/2023-13:43:56] [V] [TRT] Fastest Tactic: 0x000000000000000a Time: 0.00275437 [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWise) [04/18/2023-13:43:56] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000000a [04/18/2023-13:43:56] [V] [TRT] *************** Autotuning format combination: Half(480,160,80:32,2,1), Half(6,2,2:32,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00279086 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00294652 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00311135 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00345306 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00285006 [04/18/2023-13:43:56] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.00279086 [04/18/2023-13:43:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-13:43:56] [V] [TRT] *************** Autotuning format combination: Half(480,160,80:32,2,1), Half(6,2,2:32,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00294344 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00332417 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00390561 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00500099 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00277301 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00296686 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00321514 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00369829 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00291881 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00281968 [04/18/2023-13:43:56] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.00277301 [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWise) [04/18/2023-13:43:56] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-13:43:56] [V] [TRT] *************** Autotuning format combination: Half(3200,1:8,80,2,1), Half(2,1:8,2,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00286235 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00278383 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00283724 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00297638 [04/18/2023-13:43:56] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.00278383 [04/18/2023-13:43:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [04/18/2023-13:43:56] [V] [TRT] *************** Autotuning format combination: Half(3200,3200:32,80,2,1), Half(2,2:32,2,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00435158 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00545913 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00714514 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0105842 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0037778 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00432094 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x000000000000001a Time: 0.005144 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00693486 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0032721 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00325829 [04/18/2023-13:43:56] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00325829 [04/18/2023-13:43:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:43:56] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:56] [V] [TRT] *************** Autotuning format combination: Float(408000,136000,3400,85,1) -> Float(408000,85,1) *************** [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3 (Shuffle) [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00579456 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0198046 [04/18/2023-13:43:56] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00579456 [04/18/2023-13:43:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-13:43:56] [V] [TRT] *************** Autotuning format combination: Float(408000,136000,1,3400,40) -> Float(1,85,1) *************** [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3 (Shuffle) [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00921886 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.275456 [04/18/2023-13:43:56] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00921886 [04/18/2023-13:43:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-13:43:56] [V] [TRT] *************** Autotuning format combination: Float(102000,34000,1:4,850,10) -> Float(1:4,85,1) *************** [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3 (Shuffle) [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.215159 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0763611 [04/18/2023-13:43:56] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0763611 [04/18/2023-13:43:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:43:56] [V] [TRT] *************** Autotuning format combination: Float(20400,6800,3400:32,85,1) -> Float(408000:32,85,1) *************** [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3 (Shuffle) [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000000 Time: 2.05309 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.178322 [04/18/2023-13:43:56] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.178322 [04/18/2023-13:43:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:43:56] [V] [TRT] *************** Autotuning format combination: Half(408000,136000,3400,85,1) -> Half(408000,85,1) *************** [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3 (Shuffle) [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0132276 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.068509 [04/18/2023-13:43:56] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0132276 [04/18/2023-13:43:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-13:43:56] [V] [TRT] *************** Autotuning format combination: Half(204000,68000,3400:2,85,1) -> Half(408000:2,85,1) *************** [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3 (Shuffle) [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.055101 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.103278 [04/18/2023-13:43:56] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.055101 [04/18/2023-13:43:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-13:43:56] [V] [TRT] *************** Autotuning format combination: Half(102000,34000,1:4,850,10) -> Half(1:4,85,1) *************** [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3 (Shuffle) [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.116078 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0763703 [04/18/2023-13:43:56] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0763703 [04/18/2023-13:43:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:43:56] [V] [TRT] *************** Autotuning format combination: Half(51000,17000,1:8,425,5) -> Half(1:8,85,1) *************** [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3 (Shuffle) [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.244443 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0760686 [04/18/2023-13:43:56] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0760686 [04/18/2023-13:43:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:43:56] [V] [TRT] *************** Autotuning format combination: Half(30600,10200,1:16,255,3) -> Half(1:16,85,1) *************** [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3 (Shuffle) [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.502345 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0758491 [04/18/2023-13:43:56] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0758491 [04/18/2023-13:43:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:43:56] [V] [TRT] *************** Autotuning format combination: Half(20400,6800,3400:32,85,1) -> Half(408000:32,85,1) *************** [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3 (Shuffle) [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.01961 [04/18/2023-13:43:56] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0759954 [04/18/2023-13:43:56] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0759954 [04/18/2023-13:43:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:43:56] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:56] [V] [TRT] *************** Autotuning format combination: Int8(51200,400,20,1) -> Int8(204800,400,20,1) long-strided *************** [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:56] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:56] [V] [TRT] *************** Autotuning format combination: Int8(51200,400,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:56] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:56] [V] [TRT] *************** Autotuning format combination: Int8(12800,400:4,20,1) -> Int8(51200,400:4,20,1) long-strided *************** [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:43:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:43:56] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:56] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:56] [V] [TRT] *************** Autotuning format combination: Int8(12800,400:4,20,1) -> Int8(6400,400:32,20,1) long-strided *************** [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:56] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:56] [V] [TRT] *************** Autotuning format combination: Int8(12800,400:4,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:43:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:43:56] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:56] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:56] [V] [TRT] *************** Autotuning format combination: Int8(12800,400:4,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:56] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:56] [V] [TRT] *************** Autotuning format combination: Int8(1600,400:32,20,1) -> Int8(6400,400:32,20,1) long-strided *************** [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:43:56] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:43:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:43:56] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:56] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:56] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.00654712 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00667823 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00789173 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.00652301 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00687129 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.00778322 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00815822 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.0102991 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.010478 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0108764 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0182183 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.0106028 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.0107807 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0185737 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0308654 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00951886 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0117327 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0301559 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0303689 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0132584 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0116276 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0213133 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0309833 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.0074256 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00781353 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0313152 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0309541 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0201983 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0119436 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00879435 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00820013 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0191846 [04/18/2023-13:43:57] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.018484 [04/18/2023-13:43:57] [V] [TRT] Fastest Tactic: 0x83caf00de690c0ec Time: 0.00652301 [04/18/2023-13:43:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x83caf00de690c0ec [04/18/2023-13:43:57] [V] [TRT] *************** Autotuning format combination: Int8(1600,400:32,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-13:43:57] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:57] [V] [TRT] *************** Autotuning format combination: Int8(204800,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:57] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:57] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:43:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:43:57] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:57] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:57] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:57] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:57] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-13:43:57] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:57] [V] [TRT] *************** Autotuning format combination: Int8(102400,400,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:57] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:57] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:43:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:43:57] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:57] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:57] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:57] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:57] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-13:43:57] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-13:43:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-13:43:57] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-13:43:57] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (CaskConvolution) [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.0147173 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0147858 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0120274 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.0139607 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.0141199 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.0116906 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.0121829 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.0159126 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0162484 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0170133 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0295049 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.0162057 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.0165684 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0295515 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0524556 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0148155 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0183771 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0523215 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0524678 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0214204 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0182457 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0344137 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0529067 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.0109404 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.020431 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0539794 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0538331 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0322414 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0187897 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.0131657 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0144695 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0302281 [04/18/2023-13:43:57] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0294976 [04/18/2023-13:43:57] [V] [TRT] Fastest Tactic: 0x5e921a04a7b0e583 Time: 0.0109404 [04/18/2023-13:43:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5e921a04a7b0e583 [04/18/2023-13:43:57] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:57] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv (CudaDepthwiseConvolution) [04/18/2023-13:43:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv (CaskFlattenConvolution) [04/18/2023-13:43:57] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv (CaskConvolution) [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 0xc25454de2efcccdc [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xc25454de2efcccdc Time: 0.0185051 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: 0xff6944b17d5b2e32 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xff6944b17d5b2e32 Time: 0.0185 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0285013 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.0200406 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.0228199 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0202834 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.0283063 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0186846 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 0x1db6e8cf1382fbe0 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x1db6e8cf1382fbe0 Time: 0.0280587 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: 0xa4ae2d82115c3e83 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xa4ae2d82115c3e83 Time: 0.0220552 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.0195069 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0237192 [04/18/2023-13:43:57] [V] [TRT] Fastest Tactic: 0xff6944b17d5b2e32 Time: 0.0185 [04/18/2023-13:43:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xff6944b17d5b2e32 [04/18/2023-13:43:57] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv (CaskFlattenConvolution) [04/18/2023-13:43:57] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv (CaskConvolution) [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x733ba2a91a48d431 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x733ba2a91a48d431 Time: 0.00719337 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0xf04572b287451f42 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xf04572b287451f42 Time: 0.0097981 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x5e4f6d7c83746fd6 Time: 0.00698732 [04/18/2023-13:43:57] [V] [TRT] Fastest Tactic: 0x5e4f6d7c83746fd6 Time: 0.00698732 [04/18/2023-13:43:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-13:43:57] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv (CaskFlattenConvolution) [04/18/2023-13:43:57] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv (CaskConvolution) [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa71946688cad8664 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xa71946688cad8664 Time: 0.00622946 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x1e55f8b415964e81 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x1e55f8b415964e81 Time: 0.0125352 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.0101571 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9003f5f7ff9b1aec [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x9003f5f7ff9b1aec Time: 0.0206472 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9ec201b34455146e [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x9ec201b34455146e Time: 0.00567842 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x91930a570b557437 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x91930a570b557437 Time: 0.0205166 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdf7e1bd6a496d667 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xdf7e1bd6a496d667 Time: 0.0124846 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6d377e4222886190 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x6d377e4222886190 Time: 0.00598781 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x271b998fe31732ef [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x271b998fe31732ef Time: 0.00818489 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.00664457 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x960e9baa2a6cad5b [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x960e9baa2a6cad5b Time: 0.00606743 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.0059061 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x84942841d92b0552 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x84942841d92b0552 Time: 0.0129093 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xbeb5d91e1874a437 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xbeb5d91e1874a437 Time: 0.0123227 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcd229658c16b33cd [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xcd229658c16b33cd Time: 0.0210318 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.00841008 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.00816203 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x33a5c6dd086942c1 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x33a5c6dd086942c1 Time: 0.00580864 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7720f198395e7d3d [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x7720f198395e7d3d Time: 0.00795175 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0209593 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.0125067 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x60b880e28fee7a0c [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x60b880e28fee7a0c Time: 0.0208771 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcf64a2ae51bf6b36 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xcf64a2ae51bf6b36 Time: 0.00578469 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x844ea9c00f711f19 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x844ea9c00f711f19 Time: 0.00805156 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x65fbe45b4cb1d8a5 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x65fbe45b4cb1d8a5 Time: 0.00572178 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.00599752 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.00631732 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5bd8221bd57baf93 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x5bd8221bd57baf93 Time: 0.00614933 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0214204 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.00662691 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.0129482 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6e9c17a33c93d9b0 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x6e9c17a33c93d9b0 Time: 0.00793023 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.0136507 [04/18/2023-13:43:57] [V] [TRT] Fastest Tactic: 0x9ec201b34455146e Time: 0.00567842 [04/18/2023-13:43:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9ec201b34455146e [04/18/2023-13:43:57] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv (CaskFlattenConvolution) [04/18/2023-13:43:57] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv (CaskConvolution) [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5812ced7874b44d1 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x5812ced7874b44d1 Time: 0.00750629 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x43e3804f158e597d [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x43e3804f158e597d Time: 0.0103497 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7524377e24bc511f [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x7524377e24bc511f Time: 0.00571886 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x264d83735b1cba13 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x264d83735b1cba13 Time: 0.0106916 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3e116db8858d0d41 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x3e116db8858d0d41 Time: 0.00721874 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x758f8b2079a95b2e [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x758f8b2079a95b2e Time: 0.00704588 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7de8ad674a85e82a [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x7de8ad674a85e82a Time: 0.00534112 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x8f07802f58d278c0 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x8f07802f58d278c0 Time: 0.0162646 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x1cfa820c55616892 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x1cfa820c55616892 Time: 0.0101702 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xccdb99df0646c7b3 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xccdb99df0646c7b3 Time: 0.00551613 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcf392eca056b8d88 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xcf392eca056b8d88 Time: 0.016253 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x4f8662a723b489e1 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x4f8662a723b489e1 Time: 0.00537363 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x8e1dd2962c589dd4 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x8e1dd2962c589dd4 Time: 0.00556519 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xaba07efc49c11a6c [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xaba07efc49c11a6c Time: 0.0160163 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xd7985d83133bcf37 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xd7985d83133bcf37 Time: 0.00587081 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xb34706d47a62a016 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xb34706d47a62a016 Time: 0.00569969 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x8486adb55ae0ca6c [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x8486adb55ae0ca6c Time: 0.00995566 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x86d1488f426124e1 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x86d1488f426124e1 Time: 0.00562022 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcba01f45d37a76a0 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xcba01f45d37a76a0 Time: 0.00730377 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x62a338704beec449 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x62a338704beec449 Time: 0.0164363 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x68f52f0a3f1c5b56 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x68f52f0a3f1c5b56 Time: 0.00705263 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdb3ae212a7704d44 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xdb3ae212a7704d44 Time: 0.00583077 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x4e7f02f91ddf4673 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x4e7f02f91ddf4673 Time: 0.0169849 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xaceaca2c82ab40f3 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xaceaca2c82ab40f3 Time: 0.00598667 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xaa30815cbd0f74b7 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xaa30815cbd0f74b7 Time: 0.0160848 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6c336d1b7c64ffa3 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x6c336d1b7c64ffa3 Time: 0.00699603 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb7a90e7097d64877 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0xb7a90e7097d64877 Time: 0.00603105 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x682fae8be946411d [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x682fae8be946411d Time: 0.0105045 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x70ffb5fe2e1321e3 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x70ffb5fe2e1321e3 Time: 0.0101961 [04/18/2023-13:43:57] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x27fb8661fea664b3 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x27fb8661fea664b3 Time: 0.00569354 [04/18/2023-13:43:57] [V] [TRT] Fastest Tactic: 0x7de8ad674a85e82a Time: 0.00534112 [04/18/2023-13:43:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x7de8ad674a85e82a [04/18/2023-13:43:57] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:57] [V] [TRT] *************** Autotuning format combination: Float(102000,400,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00297189 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00289198 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00272423 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00313948 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00285006 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00271 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00378406 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00322286 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00295258 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00283868 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00296499 [04/18/2023-13:43:57] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.00271 [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWise) [04/18/2023-13:43:57] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [04/18/2023-13:43:57] [V] [TRT] *************** Autotuning format combination: Float(102000,400,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0029509 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00285105 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0027181 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00311274 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00290587 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00274875 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00390536 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0031355 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00295137 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00280695 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00299086 [04/18/2023-13:43:57] [V] [TRT] Fastest Tactic: 0x0000000000000002 Time: 0.0027181 [04/18/2023-13:43:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 [04/18/2023-13:43:57] [V] [TRT] *************** Autotuning format combination: Float(102000,1,5100,255) -> Float(102000,1,5100,255) *************** [04/18/2023-13:43:57] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00306256 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00286555 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00273346 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00317704 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00290661 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0027189 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00378454 [04/18/2023-13:43:57] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0029342 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00267979 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00251677 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0026571 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x0000000000000009 Time: 0.00251677 [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWise) [04/18/2023-13:43:58] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000009 [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Float(25600,1:4,1280,64) -> Float(25600,1:4,1280,64) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253466 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00271051 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00281725 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00279991 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00297469 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00309486 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00298581 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00330566 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0032799 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00346449 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00260937 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00276114 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00259641 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00311394 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00283052 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00271741 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00341399 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00311453 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00289298 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00297283 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00290862 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00285508 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00296508 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0035588 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00254292 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00254893 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00287214 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00253466 [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWise) [04/18/2023-13:43:58] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Float(3200,400:32,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00268868 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00312477 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00370145 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00519347 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0026869 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.0026869 [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWise) [04/18/2023-13:43:58] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Float(3200,400:32,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0030505 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00346743 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00473143 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00739017 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00267463 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0029939 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00357189 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00513633 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00297962 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00268665 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.00267463 [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Float(1:4,400,20,1) -> Float(1:4,400,20,1) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00340348 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00405574 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0053054 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00340348 [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(102000,400,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266133 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00252688 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00239764 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00282389 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.002526 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00237437 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00339647 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0028143 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00265126 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00244231 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00266955 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.00237437 [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(102000,400,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267115 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00254621 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00238431 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00272863 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00251525 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00237257 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00340473 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00283572 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00257649 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00243967 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00266912 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.00237257 [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWise) [04/18/2023-13:43:58] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(51200,400:2,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271086 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00268859 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00267031 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00309515 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00281394 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00267259 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00396182 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00330327 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00309019 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00296676 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00325797 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00298505 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00281071 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00310293 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00270266 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00252728 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00370977 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00301428 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00269333 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00263298 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00267175 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00317653 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x000000000000000f Time: 0.00252728 [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWise) [04/18/2023-13:43:58] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000000f [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(12800,1:8,640,32) -> Half(12800,1:8,640,32) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239878 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00249986 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00284011 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00255323 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00311732 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00288228 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00277741 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00342182 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00318933 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00297857 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00255625 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00265736 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00254412 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00284925 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00271621 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00270499 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00340167 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.003036 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00291946 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00281044 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00260364 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00273346 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00300438 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00342444 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00298143 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00281923 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00302724 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00370532 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00239253 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00252247 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00255804 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00289536 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00239253 [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWise) [04/18/2023-13:43:58] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(6400,1:16,320,16) -> Half(6400,1:16,320,16) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00251292 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0028091 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00284459 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0031199 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00310837 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00290551 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00400533 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00356471 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00325507 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00297292 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00250475 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00266142 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00283742 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00340029 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00254709 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00267979 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00298886 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0034265 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00254917 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00258163 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00253746 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x0000000000000014 Time: 0.00250475 [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWise) [04/18/2023-13:43:58] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000014 [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(3200,400:32,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00253867 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00288293 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00325216 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00429136 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00252784 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00252784 [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(3200,400:32,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0025729 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0029607 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00385516 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00549299 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0025292 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00274596 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00314494 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00427926 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00262616 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0025288 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.0025288 [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWise) [04/18/2023-13:43:58] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(1:8,400,20,1) -> Half(1:8,400,20,1) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00434521 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00458429 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00601448 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00862897 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00434521 [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(102000:32,400,20,1) -> Half(102000:32,400,20,1) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.026077 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.026397 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0270438 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0243832 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0231112 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0236989 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0245531 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0253981 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0256175 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0229381 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.0229381 [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:43:58] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Float(102000,400,20,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_4 + /model.77/Transpose_2 (Shuffle) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00362343 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0128419 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00362343 [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Float(102000,1,5100,255) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_4 + /model.77/Transpose_2 (Shuffle) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00588965 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0123219 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00588965 [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Float(25600,1:4,1280,64) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_4 + /model.77/Transpose_2 (Shuffle) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00605467 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.015701 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00605467 [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Float(3200,400:32,20,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_4 + /model.77/Transpose_2 (Shuffle) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.017057 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0157513 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0157513 [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(102000,400,20,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_4 + /model.77/Transpose_2 (Shuffle) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00342585 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0129288 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00342585 [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(51200,400:2,20,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_4 + /model.77/Transpose_2 (Shuffle) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00373556 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0136216 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00373556 [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(25600,1:4,1280,64) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_4 + /model.77/Transpose_2 (Shuffle) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00600076 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0123318 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00600076 [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(12800,1:8,640,32) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_4 + /model.77/Transpose_2 (Shuffle) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00693725 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0121973 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00693725 [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(6400,1:16,320,16) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_4 + /model.77/Transpose_2 (Shuffle) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.008964 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0123813 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.008964 [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(3200,400:32,20,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_4 + /model.77/Transpose_2 (Shuffle) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00906229 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0125158 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00906229 [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-13:43:58] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Float(102000,34000,1700,85,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Split_2 (Slice) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00223764 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00223764 [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Split_2 (Padding) [04/18/2023-13:43:58] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(102000,34000,1700,85,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Split_2 (Slice) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00223607 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00223607 [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Split_2 (Padding) [04/18/2023-13:43:58] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(51000,17000,1700:2,85,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Split_2 (Padding) [04/18/2023-13:43:58] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(15300,5100,1:8,255,3) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Split_2 (Padding) [04/18/2023-13:43:58] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:58] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Float(102000,34000,1700,85,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_122 (Slice) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00222636 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00222636 [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_122 (Padding) [04/18/2023-13:43:58] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(102000,34000,1700,85,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_122 (Slice) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00221721 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00221721 [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_122 (Padding) [04/18/2023-13:43:58] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(51000,17000,1700:2,85,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_122 (Padding) [04/18/2023-13:43:58] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(15300,5100,1:8,255,3) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_122 (Padding) [04/18/2023-13:43:58] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:58] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Float(102000,34000,1700,85,1) -> Float(102000,34000,1700,85,1) long-strided *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_123 (Slice) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00282263 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00282263 [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_123 (Padding) [04/18/2023-13:43:58] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Float(102000,34000,1700,85,1) -> Float(97200,32400,1620,81,1) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_123 (Slice) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00281645 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00281645 [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_123 (Padding) [04/18/2023-13:43:58] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(102000,34000,1700,85,1) -> Half(102000,34000,1700,85,1) long-strided *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_123 (Slice) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00281286 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00281286 [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_123 (Padding) [04/18/2023-13:43:58] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(102000,34000,1700,85,1) -> Half(97200,32400,1620,81,1) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_123 (Slice) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00281152 [04/18/2023-13:43:58] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00281152 [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_123 (Padding) [04/18/2023-13:43:58] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(51000,17000,1700:2,85,1) -> Half(51000,17000,1700:2,85,1) long-strided *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_123 (Padding) [04/18/2023-13:43:58] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(51000,17000,1700:2,85,1) -> Half(48600,16200,1620:2,81,1) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_123 (Padding) [04/18/2023-13:43:58] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(15300,5100,1:8,255,3) -> Half(15300,5100,1:8,255,3) long-strided *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_123 (Padding) [04/18/2023-13:43:58] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Half(15300,5100,1:8,255,3) -> Half(14580,4860,1:8,243,3) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_123 (Padding) [04/18/2023-13:43:58] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-13:43:58] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: -> Float(800,800,40,2,1) *************** [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: -> Half(800,800,40,2,1) *************** [04/18/2023-13:43:58] [V] [TRT] =============== Computing costs for [04/18/2023-13:43:58] [V] [TRT] *************** Autotuning format combination: Float(2400,800,40,2,1), Float(800,800,40,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:43:58] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00227135 [04/18/2023-13:43:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00250175 [04/18/2023-13:43:59] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0023933 [04/18/2023-13:43:59] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00280336 [04/18/2023-13:43:59] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00259241 [04/18/2023-13:43:59] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00249655 [04/18/2023-13:43:59] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00343858 [04/18/2023-13:43:59] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00296312 [04/18/2023-13:44:00] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00264754 [04/18/2023-13:44:00] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00264931 [04/18/2023-13:44:00] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00252487 [04/18/2023-13:44:00] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00227135 [04/18/2023-13:44:00] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWise) [04/18/2023-13:44:00] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:44:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [04/18/2023-13:44:00] [V] [TRT] *************** Autotuning format combination: Float(2400,800,40,2,1), Float(800,800,40,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:44:00] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-13:44:00] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250739 [04/18/2023-13:44:00] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00280121 [04/18/2023-13:44:00] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00282945 [04/18/2023-13:44:01] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00308688 [04/18/2023-13:44:01] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0029781 [04/18/2023-13:44:01] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00274787 [04/18/2023-13:44:01] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00387237 [04/18/2023-13:44:01] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00338264 [04/18/2023-13:44:01] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0030505 [04/18/2023-13:44:02] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00293989 [04/18/2023-13:44:02] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00252728 [04/18/2023-13:44:02] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250739 [04/18/2023-13:44:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [04/18/2023-13:44:02] [V] [TRT] *************** Autotuning format combination: Float(2400,800,1,40,20), Float(800,800,1,40,20) -> Float(2400,800,1,40,20) *************** [04/18/2023-13:44:02] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-13:44:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244014 [04/18/2023-13:44:02] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00269266 [04/18/2023-13:44:02] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00257861 [04/18/2023-13:44:02] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00300276 [04/18/2023-13:44:02] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00274892 [04/18/2023-13:44:02] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00266565 [04/18/2023-13:44:02] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00380343 [04/18/2023-13:44:02] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00317887 [04/18/2023-13:44:02] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00282667 [04/18/2023-13:44:02] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00286135 [04/18/2023-13:44:02] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00249695 [04/18/2023-13:44:02] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00244014 [04/18/2023-13:44:02] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWise) [04/18/2023-13:44:02] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:44:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [04/18/2023-13:44:02] [V] [TRT] *************** Autotuning format combination: Float(600,200,1:4,10,5), Float(200,200,1:4,10,5) -> Float(600,200,1:4,10,5) *************** [04/18/2023-13:44:02] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-13:44:02] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00278901 [04/18/2023-13:44:02] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00306675 [04/18/2023-13:44:02] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00377083 [04/18/2023-13:44:03] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00372173 [04/18/2023-13:44:03] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00362274 [04/18/2023-13:44:03] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00366933 [04/18/2023-13:44:03] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00451714 [04/18/2023-13:44:03] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00453671 [04/18/2023-13:44:04] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00456029 [04/18/2023-13:44:04] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00474352 [04/18/2023-13:44:04] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00278215 [04/18/2023-13:44:04] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00292198 [04/18/2023-13:44:04] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00302343 [04/18/2023-13:44:04] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00339668 [04/18/2023-13:44:05] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00352624 [04/18/2023-13:44:05] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0039276 [04/18/2023-13:44:05] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00420692 [04/18/2023-13:44:05] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00445368 [04/18/2023-13:44:05] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00504575 [04/18/2023-13:44:06] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00605924 [04/18/2023-13:44:06] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00269697 [04/18/2023-13:44:06] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00281869 [04/18/2023-13:44:06] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00321737 [04/18/2023-13:44:06] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00381281 [04/18/2023-13:44:07] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00295286 [04/18/2023-13:44:07] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00265008 [04/18/2023-13:44:07] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00276642 [04/18/2023-13:44:07] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.00265008 [04/18/2023-13:44:07] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWise) [04/18/2023-13:44:07] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:44:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [04/18/2023-13:44:07] [V] [TRT] *************** Autotuning format combination: Float(120,40,40:32,2,1), Float(40,40,40:32,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:44:07] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-13:44:07] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00292795 [04/18/2023-13:44:07] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00376421 [04/18/2023-13:44:07] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00498932 [04/18/2023-13:44:08] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0072736 [04/18/2023-13:44:08] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00292488 [04/18/2023-13:44:08] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00292488 [04/18/2023-13:44:08] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWise) [04/18/2023-13:44:08] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:44:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:44:08] [V] [TRT] *************** Autotuning format combination: Float(120,40,40:32,2,1), Float(40,40,40:32,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:44:08] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-13:44:08] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0033566 [04/18/2023-13:44:08] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00545812 [04/18/2023-13:44:08] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00793778 [04/18/2023-13:44:09] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00984868 [04/18/2023-13:44:09] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00295184 [04/18/2023-13:44:09] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00353427 [04/18/2023-13:44:09] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00444315 [04/18/2023-13:44:09] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00650764 [04/18/2023-13:44:10] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00337318 [04/18/2023-13:44:10] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00291758 [04/18/2023-13:44:10] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00291758 [04/18/2023-13:44:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:44:10] [V] [TRT] *************** Autotuning format combination: Float(800,1:4,40,2,1), Float(800,1:4,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:44:10] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-13:44:10] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00279473 [04/18/2023-13:44:10] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00265575 [04/18/2023-13:44:10] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00247086 [04/18/2023-13:44:10] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.00247086 [04/18/2023-13:44:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [04/18/2023-13:44:10] [V] [TRT] *************** Autotuning format combination: Half(2400,800,40,2,1), Half(800,800,40,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:44:10] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-13:44:10] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249647 [04/18/2023-13:44:11] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00281573 [04/18/2023-13:44:11] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00266015 [04/18/2023-13:44:11] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00319157 [04/18/2023-13:44:11] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00288969 [04/18/2023-13:44:11] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00266201 [04/18/2023-13:44:11] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00384 [04/18/2023-13:44:12] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00336585 [04/18/2023-13:44:12] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00311463 [04/18/2023-13:44:12] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00316432 [04/18/2023-13:44:12] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00253851 [04/18/2023-13:44:12] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249647 [04/18/2023-13:44:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [04/18/2023-13:44:12] [V] [TRT] *************** Autotuning format combination: Half(2400,800,40,2,1), Half(800,800,40,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:44:12] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-13:44:12] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253915 [04/18/2023-13:44:13] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00280525 [04/18/2023-13:44:13] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00258906 [04/18/2023-13:44:13] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00315399 [04/18/2023-13:44:13] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0030041 [04/18/2023-13:44:13] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00281636 [04/18/2023-13:44:13] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00386249 [04/18/2023-13:44:14] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00335351 [04/18/2023-13:44:14] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00310419 [04/18/2023-13:44:14] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00285544 [04/18/2023-13:44:14] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00262633 [04/18/2023-13:44:14] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00253915 [04/18/2023-13:44:14] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWise) [04/18/2023-13:44:14] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:44:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [04/18/2023-13:44:14] [V] [TRT] *************** Autotuning format combination: Half(1200,400,40:2,2,1), Half(400,400,40:2,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:44:14] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-13:44:14] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00263747 [04/18/2023-13:44:14] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00289481 [04/18/2023-13:44:15] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00288631 [04/18/2023-13:44:15] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00338945 [04/18/2023-13:44:15] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00340931 [04/18/2023-13:44:15] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00338785 [04/18/2023-13:44:15] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00444786 [04/18/2023-13:44:15] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00435103 [04/18/2023-13:44:16] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00441531 [04/18/2023-13:44:16] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00428074 [04/18/2023-13:44:16] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00260231 [04/18/2023-13:44:16] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00278286 [04/18/2023-13:44:16] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00260962 [04/18/2023-13:44:16] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00318029 [04/18/2023-13:44:17] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00298371 [04/18/2023-13:44:17] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00272449 [04/18/2023-13:44:17] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00399505 [04/18/2023-13:44:17] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00345491 [04/18/2023-13:44:17] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00317745 [04/18/2023-13:44:18] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00312258 [04/18/2023-13:44:18] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00264154 [04/18/2023-13:44:18] [V] [TRT] Tactic: 0x000000000000001d Time: 0.002568 [04/18/2023-13:44:18] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.002568 [04/18/2023-13:44:18] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWise) [04/18/2023-13:44:18] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:44:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [04/18/2023-13:44:18] [V] [TRT] *************** Autotuning format combination: Half(360,120,1:8,6,3), Half(120,120,1:8,6,3) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:44:18] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-13:44:18] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00294867 [04/18/2023-13:44:18] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00305109 [04/18/2023-13:44:18] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.003256 [04/18/2023-13:44:19] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00349012 [04/18/2023-13:44:19] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00369711 [04/18/2023-13:44:19] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00341682 [04/18/2023-13:44:19] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00421499 [04/18/2023-13:44:20] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0042763 [04/18/2023-13:44:20] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00368094 [04/18/2023-13:44:20] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00349101 [04/18/2023-13:44:20] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00271646 [04/18/2023-13:44:20] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00294717 [04/18/2023-13:44:21] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00314733 [04/18/2023-13:44:21] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00323901 [04/18/2023-13:44:21] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00321585 [04/18/2023-13:44:21] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00308951 [04/18/2023-13:44:21] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00355679 [04/18/2023-13:44:22] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00342596 [04/18/2023-13:44:22] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00335872 [04/18/2023-13:44:22] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00325621 [04/18/2023-13:44:22] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0027338 [04/18/2023-13:44:22] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00296154 [04/18/2023-13:44:23] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00301886 [04/18/2023-13:44:23] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00348477 [04/18/2023-13:44:23] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00271991 [04/18/2023-13:44:23] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00274346 [04/18/2023-13:44:23] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0029088 [04/18/2023-13:44:23] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00325517 [04/18/2023-13:44:24] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00292842 [04/18/2023-13:44:24] [V] [TRT] Tactic: 0x000000000000001d Time: 0.002742 [04/18/2023-13:44:24] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00272475 [04/18/2023-13:44:24] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0028715 [04/18/2023-13:44:24] [V] [TRT] Fastest Tactic: 0x000000000000000a Time: 0.00271646 [04/18/2023-13:44:24] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWise) [04/18/2023-13:44:24] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:44:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000000a [04/18/2023-13:44:24] [V] [TRT] *************** Autotuning format combination: Half(240,80,1:16,4,2), Half(80,80,1:16,4,2) -> Half(240,80,1:16,4,2) *************** [04/18/2023-13:44:24] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-13:44:24] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00289765 [04/18/2023-13:44:25] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00321737 [04/18/2023-13:44:25] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00334543 [04/18/2023-13:44:25] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00353227 [04/18/2023-13:44:25] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00370802 [04/18/2023-13:44:25] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00341529 [04/18/2023-13:44:26] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00428867 [04/18/2023-13:44:26] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00417985 [04/18/2023-13:44:26] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00373439 [04/18/2023-13:44:26] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00354442 [04/18/2023-13:44:26] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00273958 [04/18/2023-13:44:27] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00296667 [04/18/2023-13:44:27] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00328353 [04/18/2023-13:44:27] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0035617 [04/18/2023-13:44:27] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00274683 [04/18/2023-13:44:27] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00287708 [04/18/2023-13:44:27] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00311215 [04/18/2023-13:44:28] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00346024 [04/18/2023-13:44:28] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00290825 [04/18/2023-13:44:28] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00289042 [04/18/2023-13:44:28] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00276598 [04/18/2023-13:44:28] [V] [TRT] Fastest Tactic: 0x0000000000000014 Time: 0.00273958 [04/18/2023-13:44:28] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWise) [04/18/2023-13:44:28] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:44:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000014 [04/18/2023-13:44:28] [V] [TRT] *************** Autotuning format combination: Half(120,40,40:32,2,1), Half(40,40,40:32,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:44:28] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-13:44:28] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00272061 [04/18/2023-13:44:29] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00308367 [04/18/2023-13:44:29] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00350985 [04/18/2023-13:44:29] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00430467 [04/18/2023-13:44:29] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00280623 [04/18/2023-13:44:29] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.00272061 [04/18/2023-13:44:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-13:44:29] [V] [TRT] *************** Autotuning format combination: Half(120,40,40:32,2,1), Half(40,40,40:32,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:44:29] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-13:44:29] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00294643 [04/18/2023-13:44:29] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0035728 [04/18/2023-13:44:30] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00466094 [04/18/2023-13:44:30] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00614362 [04/18/2023-13:44:30] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00273579 [04/18/2023-13:44:30] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00313103 [04/18/2023-13:44:30] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00373568 [04/18/2023-13:44:31] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00486659 [04/18/2023-13:44:31] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00288137 [04/18/2023-13:44:31] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0027282 [04/18/2023-13:44:31] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.0027282 [04/18/2023-13:44:31] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWise) [04/18/2023-13:44:31] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:44:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:44:31] [V] [TRT] *************** Autotuning format combination: Half(800,1:8,40,2,1), Half(800,1:8,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:44:31] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-13:44:31] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0028169 [04/18/2023-13:44:31] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00277864 [04/18/2023-13:44:31] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00265854 [04/18/2023-13:44:32] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00261868 [04/18/2023-13:44:32] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00261868 [04/18/2023-13:44:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:44:32] [V] [TRT] *************** Autotuning format combination: Half(800,800:32,40,2,1), Half(800,800:32,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:44:32] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-13:44:32] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00297829 [04/18/2023-13:44:32] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00367871 [04/18/2023-13:44:32] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00490758 [04/18/2023-13:44:32] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00723612 [04/18/2023-13:44:32] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00289134 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00332534 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00418246 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00586843 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00290057 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00286089 [04/18/2023-13:44:33] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00286089 [04/18/2023-13:44:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:44:33] [V] [TRT] =============== Computing costs for [04/18/2023-13:44:33] [V] [TRT] *************** Autotuning format combination: -> Float(6,2,2,2,1) *************** [04/18/2023-13:44:33] [V] [TRT] *************** Autotuning format combination: -> Half(6,2,2,2,1) *************** [04/18/2023-13:44:33] [V] [TRT] =============== Computing costs for [04/18/2023-13:44:33] [V] [TRT] *************** Autotuning format combination: Float(2400,800,40,2,1), Float(6,2,2,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:44:33] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0028693 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00310877 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00297199 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00314922 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00323342 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00297301 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00344152 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00343957 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00347091 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00329455 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00246983 [04/18/2023-13:44:33] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00246983 [04/18/2023-13:44:33] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWise) [04/18/2023-13:44:33] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:44:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-13:44:33] [V] [TRT] *************** Autotuning format combination: Float(2400,800,40,2,1), Float(6,2,2,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:44:33] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00287616 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00305624 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00298648 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00314951 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00328322 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00296984 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00345143 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00362731 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00349647 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00330971 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0024763 [04/18/2023-13:44:33] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.0024763 [04/18/2023-13:44:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-13:44:33] [V] [TRT] *************** Autotuning format combination: Float(2400,800,1,40,20), Float(6,2,1,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-13:44:33] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246292 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00260206 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00247117 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00264991 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00264652 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00248197 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00281286 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00279288 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00277556 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00261029 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00246786 [04/18/2023-13:44:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246292 [04/18/2023-13:44:33] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWise) [04/18/2023-13:44:33] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:44:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [04/18/2023-13:44:33] [V] [TRT] *************** Autotuning format combination: Float(600,200,1:4,10,5), Float(6,2,1:4,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-13:44:33] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026993 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00281618 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00328426 [04/18/2023-13:44:33] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00296798 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00297647 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0028843 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00326784 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00328405 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00302943 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0031361 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00263929 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00264601 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00277547 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00278611 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00285347 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00296471 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00296807 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00311602 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00314504 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00330441 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0024692 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00262467 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00264387 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00281591 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00264965 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00262034 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00246059 [04/18/2023-13:44:34] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.00246059 [04/18/2023-13:44:34] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWise) [04/18/2023-13:44:34] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:44:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [04/18/2023-13:44:34] [V] [TRT] *************** Autotuning format combination: Float(120,40,40:32,2,1), Float(6,2,2:32,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:44:34] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00282407 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00313113 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00328717 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00365989 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0027956 [04/18/2023-13:44:34] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.0027956 [04/18/2023-13:44:34] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWise) [04/18/2023-13:44:34] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:44:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:44:34] [V] [TRT] *************** Autotuning format combination: Float(120,40,40:32,2,1), Float(6,2,2:32,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:44:34] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00327408 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.004518 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00478903 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00543103 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0028177 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00299533 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00319187 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00356928 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00326483 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0027884 [04/18/2023-13:44:34] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.0027884 [04/18/2023-13:44:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:44:34] [V] [TRT] *************** Autotuning format combination: Float(800,1:4,40,2,1), Float(2,1:4,2,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-13:44:34] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00280605 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00264087 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00262699 [04/18/2023-13:44:34] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.00262699 [04/18/2023-13:44:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [04/18/2023-13:44:34] [V] [TRT] *************** Autotuning format combination: Half(2400,800,40,2,1), Half(6,2,2,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-13:44:34] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00288676 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00312845 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0029523 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00321585 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00329195 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00294661 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00349525 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00362537 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00349859 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00328852 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00247314 [04/18/2023-13:44:34] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00247314 [04/18/2023-13:44:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-13:44:34] [V] [TRT] *************** Autotuning format combination: Half(2400,800,40,2,1), Half(6,2,2,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-13:44:34] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00295053 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00312874 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00294353 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0032065 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00329257 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00301743 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00349112 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00361611 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00334756 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00306859 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00230761 [04/18/2023-13:44:34] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00230761 [04/18/2023-13:44:34] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWise) [04/18/2023-13:44:34] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:44:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-13:44:34] [V] [TRT] *************** Autotuning format combination: Half(1200,400,40:2,2,1), Half(6,2,2:2,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-13:44:34] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00276888 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00282801 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00278242 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00303486 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00294297 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00281609 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00338711 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00321046 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00308075 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00293887 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00252511 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00261611 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00248702 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00277925 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00276782 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00252102 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00322286 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00293495 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00276202 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00261544 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00259339 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00239215 [04/18/2023-13:44:34] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.00239215 [04/18/2023-13:44:34] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWise) [04/18/2023-13:44:34] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:44:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [04/18/2023-13:44:34] [V] [TRT] *************** Autotuning format combination: Half(360,120,1:8,6,3), Half(6,2,1:8,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-13:44:34] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00281026 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00301667 [04/18/2023-13:44:34] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00322499 [04/18/2023-13:44:35] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00339519 [04/18/2023-13:44:35] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00346318 [04/18/2023-13:44:35] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00336415 [04/18/2023-13:44:35] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00391784 [04/18/2023-13:44:35] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0040033 [04/18/2023-13:44:36] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00389177 [04/18/2023-13:44:36] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00378141 [04/18/2023-13:44:36] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00283635 [04/18/2023-13:44:36] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00311096 [04/18/2023-13:44:37] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00324789 [04/18/2023-13:44:37] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00329745 [04/18/2023-13:44:37] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00337276 [04/18/2023-13:44:37] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00321077 [04/18/2023-13:44:37] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00375964 [04/18/2023-13:44:37] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00354854 [04/18/2023-13:44:38] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00346634 [04/18/2023-13:44:38] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00339296 [04/18/2023-13:44:38] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00289143 [04/18/2023-13:44:38] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00296751 [04/18/2023-13:44:38] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00324256 [04/18/2023-13:44:39] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00355713 [04/18/2023-13:44:39] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00281071 [04/18/2023-13:44:39] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00276194 [04/18/2023-13:44:39] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00295911 [04/18/2023-13:44:39] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00319908 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00290368 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00279631 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00280659 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00278787 [04/18/2023-13:44:40] [V] [TRT] Fastest Tactic: 0x0000000000000019 Time: 0.00276194 [04/18/2023-13:44:40] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWise) [04/18/2023-13:44:40] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:44:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000019 [04/18/2023-13:44:40] [V] [TRT] *************** Autotuning format combination: Half(240,80,1:16,4,2), Half(6,2,1:16,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-13:44:40] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00281609 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00332208 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00334629 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00393761 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00377155 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0034326 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0050932 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00428665 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0037979 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00367707 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00268538 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00297292 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00316283 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00361109 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00268131 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00283653 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00301619 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00343935 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00281726 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00276923 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00265939 [04/18/2023-13:44:40] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00265939 [04/18/2023-13:44:40] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWise) [04/18/2023-13:44:40] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:44:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:44:40] [V] [TRT] *************** Autotuning format combination: Half(120,40,40:32,2,1), Half(6,2,2:32,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-13:44:40] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00270077 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00281636 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00298086 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00329797 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00279024 [04/18/2023-13:44:40] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.00270077 [04/18/2023-13:44:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-13:44:40] [V] [TRT] *************** Autotuning format combination: Half(120,40,40:32,2,1), Half(6,2,2:32,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-13:44:40] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00279306 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00326722 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00379152 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00495259 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00273492 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00295949 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00314127 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00363977 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00285824 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00277793 [04/18/2023-13:44:40] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.00273492 [04/18/2023-13:44:40] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWise) [04/18/2023-13:44:40] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-13:44:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-13:44:40] [V] [TRT] *************** Autotuning format combination: Half(800,1:8,40,2,1), Half(2,1:8,2,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-13:44:40] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00280892 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00267945 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00264511 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00264478 [04/18/2023-13:44:40] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00264478 [04/18/2023-13:44:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:44:40] [V] [TRT] *************** Autotuning format combination: Half(800,800:32,40,2,1), Half(2,2:32,2,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-13:44:40] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00313978 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00364892 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0043574 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00560317 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00296172 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00312785 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00344664 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00396689 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0029426 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00280176 [04/18/2023-13:44:40] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00280176 [04/18/2023-13:44:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-13:44:40] [V] [TRT] =============== Computing costs for [04/18/2023-13:44:40] [V] [TRT] *************** Autotuning format combination: Float(102000,34000,1700,85,1) -> Float(102000,85,1) *************** [04/18/2023-13:44:40] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5 (Shuffle) [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251693 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0123211 [04/18/2023-13:44:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251693 [04/18/2023-13:44:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-13:44:40] [V] [TRT] *************** Autotuning format combination: Float(102000,34000,1,1700,20) -> Float(1,85,1) *************** [04/18/2023-13:44:40] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5 (Shuffle) [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00459386 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0784823 [04/18/2023-13:44:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00459386 [04/18/2023-13:44:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-13:44:40] [V] [TRT] *************** Autotuning format combination: Float(25500,8500,1:4,425,5) -> Float(1:4,85,1) *************** [04/18/2023-13:44:40] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5 (Shuffle) [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0572008 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0180994 [04/18/2023-13:44:40] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0180994 [04/18/2023-13:44:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:44:40] [V] [TRT] *************** Autotuning format combination: Float(5100,1700,1700:32,85,1) -> Float(102000:32,85,1) *************** [04/18/2023-13:44:40] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5 (Shuffle) [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.512731 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0530377 [04/18/2023-13:44:40] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0530377 [04/18/2023-13:44:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:44:40] [V] [TRT] *************** Autotuning format combination: Half(102000,34000,1700,85,1) -> Half(102000,85,1) *************** [04/18/2023-13:44:40] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5 (Shuffle) [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232538 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0122232 [04/18/2023-13:44:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00232538 [04/18/2023-13:44:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-13:44:40] [V] [TRT] *************** Autotuning format combination: Half(51000,17000,1700:2,85,1) -> Half(102000:2,85,1) *************** [04/18/2023-13:44:40] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5 (Shuffle) [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0162824 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.013103 [04/18/2023-13:44:40] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.013103 [04/18/2023-13:44:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:44:40] [V] [TRT] *************** Autotuning format combination: Half(25500,8500,1:4,425,5) -> Half(1:4,85,1) *************** [04/18/2023-13:44:40] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5 (Shuffle) [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0315355 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0230282 [04/18/2023-13:44:40] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0230282 [04/18/2023-13:44:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:44:40] [V] [TRT] *************** Autotuning format combination: Half(15300,5100,1:8,255,3) -> Half(1:8,85,1) *************** [04/18/2023-13:44:40] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5 (Shuffle) [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0636663 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0184503 [04/18/2023-13:44:40] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0184503 [04/18/2023-13:44:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:44:40] [V] [TRT] *************** Autotuning format combination: Half(10200,3400,1:16,170,2) -> Half(1:16,85,1) *************** [04/18/2023-13:44:40] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5 (Shuffle) [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.126171 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0234651 [04/18/2023-13:44:40] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0234651 [04/18/2023-13:44:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:44:40] [V] [TRT] *************** Autotuning format combination: Half(5100,1700,1700:32,85,1) -> Half(102000:32,85,1) *************** [04/18/2023-13:44:40] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5 (Shuffle) [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.255707 [04/18/2023-13:44:40] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0228369 [04/18/2023-13:44:40] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0228369 [04/18/2023-13:44:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-13:44:40] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to PWN(/model.0/act/LeakyRelu) (/model.0/conv/Conv_output_0) from Float(3276800,102400,320,1) to Half(102400,102400:32,320,1) [04/18/2023-13:44:40] [V] [TRT] Adding reformat layer: Reformatted Output Tensor 0 to model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) (/model.14/act/LeakyRelu_output_0) from Half(25600,6400:32,80,1) to Half(102400,1:8,1280,16) [04/18/2023-13:44:40] [V] [TRT] Adding reformat layer: Reformatted Output Tensor 0 to model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (/model.21/act/LeakyRelu_output_0) from Half(12800,1600:32,40,1) to Half(204800,1600:2,40,1) [04/18/2023-13:44:40] [V] [TRT] Formats and tactics selection completed in 319.216 seconds. [04/18/2023-13:44:40] [V] [TRT] After reformat layers: 141 layers [04/18/2023-13:44:40] [V] [TRT] Total number of blocks in pre-optimized block assignment: 95 [04/18/2023-13:44:40] [I] [TRT] Total Activation Memory: 25508688896 [04/18/2023-13:44:40] [I] [TRT] Detected 1 inputs and 4 output network tensors. [04/18/2023-13:44:40] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-13:44:40] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-13:44:40] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:44:40] [V] [TRT] model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-13:44:40] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-13:44:40] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-13:44:40] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:44:40] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm72_xmma_pooling_IMMA_NCxHW32_generic_kMAX Tactic: 0x94215b398b8eb3ba [04/18/2023-13:44:40] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:44:40] [V] [TRT] model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:44:40] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-13:44:40] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-13:44:40] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-13:44:40] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_coalescedC_NHWC_kMAX_2_False Tactic: 0xf9ae51e35ff7f5db [04/18/2023-13:44:40] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:44:40] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:44:40] [V] [TRT] model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:44:40] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-13:44:40] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-13:44:40] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x2640501019a61dc2 [04/18/2023-13:44:40] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_CHWPacked_NCxHW2_kMAX Tactic: 0xc8ae100b63fd8921 [04/18/2023-13:44:40] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:44:40] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:44:40] [V] [TRT] model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:44:40] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-13:44:40] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-13:44:41] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:44:41] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:44:41] [V] [TRT] model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:44:41] [V] [TRT] /model.31/m/MaxPool Set Tactic Name: sm72_xmma_pooling_IMMA_NCxHW32_generic_kMAX Tactic: 0x94215b398b8eb3ba [04/18/2023-13:44:41] [V] [TRT] /model.32/m/MaxPool Set Tactic Name: sm72_xmma_pooling_IMMA_NCxHW32_generic_kMAX Tactic: 0x94215b398b8eb3ba [04/18/2023-13:44:41] [V] [TRT] /model.33/m/MaxPool Set Tactic Name: sm72_xmma_pooling_IMMA_NCxHW32_generic_kMAX Tactic: 0x94215b398b8eb3ba [04/18/2023-13:44:41] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:44:41] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-13:44:41] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:44:41] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:44:41] [V] [TRT] model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:44:41] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-13:44:41] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-13:44:41] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-13:44:41] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:44:41] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:44:41] [V] [TRT] model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-13:44:41] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-13:44:41] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-13:44:41] [V] [TRT] model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-13:44:41] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xbb88763c3b0e94d4 [04/18/2023-13:44:41] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-13:44:41] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x733ba2a91a48d431 [04/18/2023-13:44:41] [V] [TRT] model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:44:41] [V] [TRT] model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:44:41] [V] [TRT] model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-13:44:41] [V] [TRT] model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-13:44:41] [V] [TRT] model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-13:44:41] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3f592fae61c7986 [04/18/2023-13:44:41] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-13:44:41] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x733ba2a91a48d431 [04/18/2023-13:44:41] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:44:41] [V] [TRT] model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-13:44:41] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-13:44:41] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-13:44:41] [V] [TRT] model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-13:44:41] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-13:44:41] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-13:44:41] [V] [TRT] Layer: model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Host Persistent: 1664 Device Persistent: 614912 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: PWN(/model.0/act/LeakyRelu) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: /model.8/m/MaxPool Host Persistent: 1344 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Host Persistent: 5792 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: /model.15/m/MaxPool Host Persistent: 1280 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Host Persistent: 5792 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: /model.22/m/MaxPool Host Persistent: 1280 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: /model.31/m/MaxPool Host Persistent: 1344 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: /model.32/m/MaxPool Host Persistent: 1344 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: /model.33/m/MaxPool Host Persistent: 1344 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Host Persistent: 5792 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Host Persistent: 5792 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Host Persistent: 5792 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: PWN(/model.77/Sigmoid) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) Host Persistent: 372 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) Host Persistent: 372 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Host Persistent: 5792 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: PWN(/model.77/Sigmoid_1) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) Host Persistent: 372 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) Host Persistent: 372 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: PWN(/model.77/Sigmoid_2) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) Host Persistent: 372 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Layer: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) Host Persistent: 372 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-13:44:41] [V] [TRT] Skipped printing memory information for 67 layers with 0 memory size i.e. Host Persistent + Device Persistent + Scratch Memory == 0. [04/18/2023-13:44:41] [I] [TRT] Total Host Persistent Memory: 191296 [04/18/2023-13:44:41] [I] [TRT] Total Device Persistent Memory: 614912 [04/18/2023-13:44:41] [I] [TRT] Total Scratch Memory: 0 [04/18/2023-13:44:41] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 31 MiB, GPU 214 MiB [04/18/2023-13:44:41] [I] [TRT] [BlockAssignment] Started assigning block shifts. This will take 94 steps to complete. [04/18/2023-13:44:41] [I] [TRT] [BlockAssignment] Algorithm ShiftNTopDown took 4.71811ms to assign 8 blocks to 94 nodes requiring 21862400 bytes. [04/18/2023-13:44:41] [V] [TRT] Total number of blocks in optimized block assignment: 8 [04/18/2023-13:44:41] [I] [TRT] Total Activation Memory: 21862400 [04/18/2023-13:44:41] [I] [TRT] (Sparsity) Layers eligible for sparse math: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu), model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu), model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu), model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu), model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu), model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu), model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu), model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu), model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu), model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu), model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu), model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu), model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu), model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu), model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu), model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu), model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu), model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu), model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu), model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu), model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu), model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu), model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu), model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu), model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu), model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu), model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu), model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu), model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu), model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu), model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu), model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu), model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu), model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu), model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu), model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu), model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu), model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu), model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu), model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu), model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu), model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu), model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu), model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu), model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu), model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu), model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu), model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) [04/18/2023-13:44:41] [I] [TRT] (Sparsity) TRT inference plan picked sparse implementation for layers: [04/18/2023-13:44:41] [V] [TRT] Finalize: model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set kernel index: 0 [04/18/2023-13:44:41] [V] [TRT] Finalize: PWN(/model.0/act/LeakyRelu) Set kernel index: 1 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set kernel index: 2 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set kernel index: 3 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) Set kernel index: 3 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set kernel index: 4 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set kernel index: 4 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set kernel index: 5 [04/18/2023-13:44:41] [V] [TRT] Finalize: /model.8/m/MaxPool Set kernel index: 6 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set kernel index: 7 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) Set kernel index: 7 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set kernel index: 8 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set kernel index: 8 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set kernel index: 9 [04/18/2023-13:44:41] [V] [TRT] Finalize: /model.15/m/MaxPool Set kernel index: 10 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set kernel index: 11 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set kernel index: 12 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) Set kernel index: 12 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set kernel index: 13 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set kernel index: 13 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set kernel index: 14 [04/18/2023-13:44:41] [V] [TRT] Finalize: /model.22/m/MaxPool Set kernel index: 15 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set kernel index: 16 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set kernel index: 17 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) Set kernel index: 17 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set kernel index: 18 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set kernel index: 18 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set kernel index: 19 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set kernel index: 20 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) Set kernel index: 21 [04/18/2023-13:44:41] [V] [TRT] Finalize: /model.31/m/MaxPool Set kernel index: 6 [04/18/2023-13:44:41] [V] [TRT] Finalize: /model.32/m/MaxPool Set kernel index: 6 [04/18/2023-13:44:41] [V] [TRT] Finalize: /model.33/m/MaxPool Set kernel index: 6 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set kernel index: 20 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set kernel index: 22 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set kernel index: 23 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set kernel index: 24 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) Set kernel index: 24 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set kernel index: 25 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set kernel index: 25 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set kernel index: 26 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set kernel index: 27 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set kernel index: 28 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) Set kernel index: 28 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set kernel index: 29 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set kernel index: 29 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) Set kernel index: 30 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set kernel index: 31 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set kernel index: 32 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set kernel index: 33 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) Set kernel index: 34 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) Set kernel index: 34 [04/18/2023-13:44:41] [V] [TRT] Finalize: PWN(/model.77/Sigmoid) Set kernel index: 35 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) Set kernel index: 36 [04/18/2023-13:44:41] [V] [TRT] Finalize: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) Set kernel index: 37 [04/18/2023-13:44:41] [V] [TRT] Finalize: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) Set kernel index: 38 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) Set kernel index: 36 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) Set kernel index: 39 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set kernel index: 40 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set kernel index: 41 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set kernel index: 33 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set kernel index: 42 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) Set kernel index: 42 [04/18/2023-13:44:41] [V] [TRT] Finalize: PWN(/model.77/Sigmoid_1) Set kernel index: 43 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set kernel index: 44 [04/18/2023-13:44:41] [V] [TRT] Finalize: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) Set kernel index: 45 [04/18/2023-13:44:41] [V] [TRT] Finalize: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) Set kernel index: 46 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set kernel index: 47 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) Set kernel index: 48 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set kernel index: 49 [04/18/2023-13:44:41] [V] [TRT] Finalize: model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set kernel index: 50 [04/18/2023-13:44:41] [V] [TRT] Finalize: PWN(/model.77/Sigmoid_2) Set kernel index: 51 [04/18/2023-13:44:41] [V] [TRT] Finalize: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) Set kernel index: 52 [04/18/2023-13:44:41] [V] [TRT] Finalize: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) Set kernel index: 38 [04/18/2023-13:44:41] [V] [TRT] Total number of generated kernels selected for the engine: 53 [04/18/2023-13:44:41] [V] [TRT] Kernel: 0 CASK_STATIC [04/18/2023-13:44:41] [V] [TRT] Kernel: 1 TRT_SERIALIZABLE:generatedNativePointwise [04/18/2023-13:44:41] [V] [TRT] Kernel: 2 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 3 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 4 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 5 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 6 CASK_STATIC [04/18/2023-13:44:41] [V] [TRT] Kernel: 7 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 8 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 9 CASK_JIT [04/18/2023-13:44:41] [V] [TRT] Kernel: 10 CASK_STATIC [04/18/2023-13:44:41] [V] [TRT] Kernel: 11 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 12 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 13 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 14 CASK_JIT [04/18/2023-13:44:41] [V] [TRT] Kernel: 15 CASK_STATIC [04/18/2023-13:44:41] [V] [TRT] Kernel: 16 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 17 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 18 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 19 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 20 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 21 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 22 CASK_JIT [04/18/2023-13:44:41] [V] [TRT] Kernel: 23 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 24 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 25 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 26 CASK_JIT [04/18/2023-13:44:41] [V] [TRT] Kernel: 27 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 28 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 29 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 30 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 31 CASK_JIT [04/18/2023-13:44:41] [V] [TRT] Kernel: 32 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 33 CASK_STATIC [04/18/2023-13:44:41] [V] [TRT] Kernel: 34 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 35 TRT_SERIALIZABLE:generatedNativePointwise [04/18/2023-13:44:41] [V] [TRT] Kernel: 36 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 37 TRT_SERIALIZABLE:generatedNativePointwise [04/18/2023-13:44:41] [V] [TRT] Kernel: 38 TRT_SERIALIZABLE:generatedNativePointwise [04/18/2023-13:44:41] [V] [TRT] Kernel: 39 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 40 CASK_JIT [04/18/2023-13:44:41] [V] [TRT] Kernel: 41 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 42 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 43 TRT_SERIALIZABLE:generatedNativePointwise [04/18/2023-13:44:41] [V] [TRT] Kernel: 44 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 45 TRT_SERIALIZABLE:generatedNativePointwise [04/18/2023-13:44:41] [V] [TRT] Kernel: 46 TRT_SERIALIZABLE:generatedNativePointwise [04/18/2023-13:44:41] [V] [TRT] Kernel: 47 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 48 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 49 CASK_LINKABLE [04/18/2023-13:44:41] [V] [TRT] Kernel: 50 CASK_STATIC [04/18/2023-13:44:41] [V] [TRT] Kernel: 51 TRT_SERIALIZABLE:generatedNativePointwise [04/18/2023-13:44:41] [V] [TRT] Kernel: 52 TRT_SERIALIZABLE:generatedNativePointwise [04/18/2023-13:44:41] [V] [TRT] Disabling unused tactic source: CUDNN [04/18/2023-13:44:41] [V] [TRT] Disabling unused tactic source: CUBLAS, CUBLAS_LT [04/18/2023-13:44:41] [V] [TRT] Engine generation completed in 320.363 seconds. [04/18/2023-13:44:41] [V] [TRT] Deleting timing cache: 2987 entries, served 1847 hits since creation. [04/18/2023-13:44:41] [V] [TRT] Engine Layer Information: Layer(Constant): /model.77/Constant_2_output_0, Tactic: 0x0000000000000000, -> (Unnamed Layer* 634) [Constant]_output (Half[1,1,80,80,2]) Layer(Constant): /model.77/Constant_4_output_0, Tactic: 0x0000000000000000, -> (Unnamed Layer* 639) [Constant]_output (Half[1,3,1,1,2]) Layer(Constant): /model.77/Constant_8_output_0, Tactic: 0x0000000000000000, -> (Unnamed Layer* 662) [Constant]_output (Half[1,1,40,40,2]) Layer(Constant): /model.77/Constant_10_output_0, Tactic: 0x0000000000000000, -> (Unnamed Layer* 667) [Constant]_output (Half[1,3,1,1,2]) Layer(Reformat): /model.0/conv/_input_quantizer/QuantizeLinear, Tactic: 0x0000000000000000, images (Float[1,3,640,640]) -> /model.0/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,3:4,640,640]) Layer(CaskConvolution): model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv, Tactic: 0xfe80445f7bb61a99, /model.0/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,3:4,640,640]) -> /model.0/conv/Conv_output_0 (Float[1,32,320,320]) Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to PWN(/model.0/act/LeakyRelu), Tactic: 0x00000000000003ea, /model.0/conv/Conv_output_0 (Float[1,32,320,320]) -> Reformatted Input Tensor 0 to PWN(/model.0/act/LeakyRelu) (Half[1,32:32,320,320]) Layer(PointWiseV2): PWN(/model.0/act/LeakyRelu), Tactic: 0x000000000000000a, Reformatted Input Tensor 0 to PWN(/model.0/act/LeakyRelu) (Half[1,32:32,320,320]) -> /model.1/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,320,320]) Layer(CaskConvolution): model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu), Tactic: 0xa085d13614221ec4, /model.1/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,320,320]) -> /model.2/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,160,160]) Layer(CaskConvolution): model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu), Tactic: 0x3321b9c38b0ba08d, /model.2/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,160,160]) -> /model.7/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,160,160]) Layer(CaskConvolution): model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu), Tactic: 0x3321b9c38b0ba08d, /model.2/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,160,160]) -> /model.4/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,160,160]) Layer(CaskConvolution): model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu), Tactic: 0xb35096a016bb733a, /model.4/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,160,160]) -> /model.5/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,160,160]) Layer(CaskConvolution): model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu), Tactic: 0xb35096a016bb733a, /model.5/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,160,160]) -> /model.7/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,160,160]) Layer(Reformat): /model.5/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.5/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,160,160]) -> /model.7/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,160,160]) Layer(Reformat): /model.4/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.4/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,160,160]) -> /model.7/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,160,160]) Layer(CaskConvolution): model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu), Tactic: 0x0779fa4ac8f9f2ee, /model.7/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,160,160]) -> /model.8/m/MaxPool_output_0 (Int8[1,64:32,160,160]) Layer(CaskPooling): /model.8/m/MaxPool, Tactic: 0x94215b398b8eb3ba, /model.8/m/MaxPool_output_0 (Int8[1,64:32,160,160]) -> /model.9/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) Layer(CaskConvolution): model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu), Tactic: 0x25bf7139bbd93bc8, /model.9/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) -> /model.14/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) Layer(CaskConvolution): model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu), Tactic: 0x25bf7139bbd93bc8, /model.9/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) -> /model.11/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) Layer(CaskConvolution): model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu), Tactic: 0xfbcd5a1da537e27f, /model.11/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) -> /model.12/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) Layer(CaskConvolution): model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu), Tactic: 0xfbcd5a1da537e27f, /model.12/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) -> /model.14/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) Layer(Reformat): /model.12/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.12/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) -> /model.14/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) Layer(Reformat): /model.11/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.11/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) -> /model.14/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) Layer(CaskJitConv): model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu), Tactic: 0x4f35593c356e2e7e, /model.14/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,80,80]) -> Reformatted Output Tensor 0 to model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) (Half[1,128:32,80,80]) Layer(Reformat): Reformatting CopyNode for Output Tensor 0 to model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu), Tactic: 0x00000000000003ea, Reformatted Output Tensor 0 to model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) (Half[1,128:32,80,80]) -> /model.14/act/LeakyRelu_output_0 (Half[1,128:8,80,80]) Layer(CaskPooling): /model.15/m/MaxPool, Tactic: 0xf9ae51e35ff7f5db, /model.14/act/LeakyRelu_output_0 (Half[1,128:8,80,80]) -> /model.15/m/MaxPool_output_0 (Half[1,128:8,40,40]) Layer(Reformat): /model.50/conv/_input_quantizer/QuantizeLinear, Tactic: 0x00000000000003ea, /model.14/act/LeakyRelu_output_0 (Half[1,128:8,80,80]) -> /model.50/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,80,80]) Layer(Reformat): /model.16/conv/_input_quantizer/QuantizeLinear, Tactic: 0x00000000000003ea, /model.15/m/MaxPool_output_0 (Half[1,128:8,40,40]) -> /model.16/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) Layer(Reformat): /model.17/conv/_input_quantizer/QuantizeLinear, Tactic: 0x00000000000003ea, /model.15/m/MaxPool_output_0 (Half[1,128:8,40,40]) -> /model.17/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) Layer(CaskConvolution): model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu), Tactic: 0x25bf7139bbd93bc8, /model.50/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,80,80]) -> /model.52/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) Layer(CaskConvolution): model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu), Tactic: 0x0779fa4ac8f9f2ee, /model.16/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) -> /model.21/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) Layer(CaskConvolution): model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu), Tactic: 0x0779fa4ac8f9f2ee, /model.17/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) -> /model.18/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) Layer(CaskConvolution): model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu), Tactic: 0xa085d13614221ec4, /model.18/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) -> /model.19/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) Layer(CaskConvolution): model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu), Tactic: 0xa085d13614221ec4, /model.19/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) -> /model.21/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) Layer(Reformat): /model.19/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.19/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) -> /model.21/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) Layer(Reformat): /model.18/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.18/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) -> /model.21/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) Layer(CaskJitConv): model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu), Tactic: 0x2640501019a61dc2, /model.21/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,512:32,40,40]) -> Reformatted Output Tensor 0 to model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (Half[1,256:32,40,40]) Layer(Reformat): Reformatting CopyNode for Output Tensor 0 to model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu), Tactic: 0x00000000000003e8, Reformatted Output Tensor 0 to model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (Half[1,256:32,40,40]) -> /model.21/act/LeakyRelu_output_0 (Half[1,256:2,40,40]) Layer(CaskPooling): /model.22/m/MaxPool, Tactic: 0xc8ae100b63fd8921, /model.21/act/LeakyRelu_output_0 (Half[1,256:2,40,40]) -> /model.22/m/MaxPool_output_0 (Half[1,256:2,20,20]) Layer(Reformat): /model.40/conv/_input_quantizer/QuantizeLinear, Tactic: 0x00000000000003ea, /model.21/act/LeakyRelu_output_0 (Half[1,256:2,40,40]) -> /model.40/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,40,40]) Layer(Reformat): /model.23/conv/_input_quantizer/QuantizeLinear, Tactic: 0x0000000000000000, /model.22/m/MaxPool_output_0 (Half[1,256:2,20,20]) -> /model.23/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(Reformat): /model.24/conv/_input_quantizer/QuantizeLinear, Tactic: 0x00000000000003e8, /model.22/m/MaxPool_output_0 (Half[1,256:2,20,20]) -> /model.24/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(CaskConvolution): model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu), Tactic: 0x0779fa4ac8f9f2ee, /model.40/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,40,40]) -> /model.42/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) Layer(CaskConvolution): model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu), Tactic: 0x4862d9a1cd4ec818, /model.23/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) -> /model.28/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(CaskConvolution): model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu), Tactic: 0x4862d9a1cd4ec818, /model.24/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) -> /model.25/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(CaskConvolution): model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu), Tactic: 0x83caf00de690c0ec, /model.25/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) -> /model.26/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(CaskConvolution): model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu), Tactic: 0x83caf00de690c0ec, /model.26/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) -> /model.28/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(Reformat): /model.26/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.26/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) -> /model.28/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(Reformat): /model.25/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.25/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) -> /model.28/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(CaskConvolution): model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu), Tactic: 0x0779fa4ac8f9f2ee, /model.28/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,1024:32,20,20]) -> /model.29/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,512:32,20,20]) Layer(CaskConvolution): model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu), Tactic: 0x4862d9a1cd4ec818, /model.29/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,512:32,20,20]) -> /model.37/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(CaskConvolution): model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu), Tactic: 0x4862d9a1cd4ec818, /model.29/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,512:32,20,20]) -> /model.31/m/MaxPool_output_0 (Int8[1,256:32,20,20]) Layer(CaskPooling): /model.31/m/MaxPool, Tactic: 0x94215b398b8eb3ba, /model.31/m/MaxPool_output_0 (Int8[1,256:32,20,20]) -> /model.35/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(CaskPooling): /model.32/m/MaxPool, Tactic: 0x94215b398b8eb3ba, /model.31/m/MaxPool_output_0 (Int8[1,256:32,20,20]) -> /model.35/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(CaskPooling): /model.33/m/MaxPool, Tactic: 0x94215b398b8eb3ba, /model.31/m/MaxPool_output_0 (Int8[1,256:32,20,20]) -> /model.35/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(Reformat): /model.31/m/MaxPool_output_0 copy, Tactic: 0x0000000000000000, /model.31/m/MaxPool_output_0 (Int8[1,256:32,20,20]) -> /model.35/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(CaskConvolution): model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu), Tactic: 0x4862d9a1cd4ec818, /model.35/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,1024:32,20,20]) -> /model.37/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(CaskJitConv): model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu), Tactic: 0x31de506085a332d4, /model.37/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,512:32,20,20]) -> /model.67/Concat_output_0 (Half[1,256:32,20,20]) Layer(Reformat): /model.38/conv/_input_quantizer/QuantizeLinear, Tactic: 0x00000000000003e8, /model.67/Concat_output_0 (Half[1,256:32,20,20]) -> /model.38/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(CaskConvolution): model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu), Tactic: 0xeb1602207b0c3d49, /model.38/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) -> /model.39/Resize_output_0 (Int8[1,128:32,20,20]) Layer(Resize): /model.39/Resize, Tactic: 0x0000000000000005, /model.39/Resize_output_0 (Int8[1,128:32,20,20]) -> /model.41/Concat_/model.39/Resize_output_0_clone_1 (Int8[1,128:32,40,40]) Layer(Reformat): /model.41/Concat_/model.39/Resize_output_0_clone_1 copy, Tactic: 0x0000000000000000, /model.41/Concat_/model.39/Resize_output_0_clone_1 (Int8[1,128:32,40,40]) -> /model.42/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) Layer(CaskConvolution): model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu), Tactic: 0x0779fa4ac8f9f2ee, /model.42/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,40,40]) -> /model.47/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) Layer(CaskConvolution): model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu), Tactic: 0x0779fa4ac8f9f2ee, /model.42/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,40,40]) -> /model.44/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) Layer(CaskConvolution): model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu), Tactic: 0x83caf00de690c0ec, /model.44/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) -> /model.45/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) Layer(CaskConvolution): model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu), Tactic: 0x83caf00de690c0ec, /model.45/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) -> /model.47/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) Layer(Reformat): /model.45/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.45/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) -> /model.47/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) Layer(Reformat): /model.44/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.44/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) -> /model.47/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) Layer(CaskJitConv): model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu), Tactic: 0xc22b2f91e37e472a, /model.47/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,40,40]) -> /model.59/Concat_output_0 (Half[1,128:32,40,40]) Layer(Reformat): /model.48/conv/_input_quantizer/QuantizeLinear, Tactic: 0x00000000000003e8, /model.59/Concat_output_0 (Half[1,128:32,40,40]) -> /model.48/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) Layer(CaskConvolution): model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu), Tactic: 0x4862d9a1cd4ec818, /model.48/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) -> /model.49/Resize_output_0 (Int8[1,64:32,40,40]) Layer(Resize): /model.49/Resize, Tactic: 0x0000000000000005, /model.49/Resize_output_0 (Int8[1,64:32,40,40]) -> /model.51/Concat_/model.49/Resize_output_0_clone_1 (Int8[1,64:32,80,80]) Layer(Reformat): /model.51/Concat_/model.49/Resize_output_0_clone_1 copy, Tactic: 0x0000000000000000, /model.51/Concat_/model.49/Resize_output_0_clone_1 (Int8[1,64:32,80,80]) -> /model.52/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) Layer(CaskConvolution): model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu), Tactic: 0xa40d21cb7ebb07bf, /model.52/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,80,80]) -> /model.57/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,80,80]) Layer(CaskConvolution): model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu), Tactic: 0xa40d21cb7ebb07bf, /model.52/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,80,80]) -> /model.54/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,80,80]) Layer(CaskConvolution): model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu), Tactic: 0x5e921a04a7b0e583, /model.54/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,80,80]) -> /model.55/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,80,80]) Layer(CaskConvolution): model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu), Tactic: 0x5e921a04a7b0e583, /model.55/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,80,80]) -> /model.57/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,80,80]) Layer(Reformat): /model.55/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.55/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,80,80]) -> /model.57/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,80,80]) Layer(Reformat): /model.54/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.54/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,80,80]) -> /model.57/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,80,80]) Layer(CaskConvolution): model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu), Tactic: 0x25bf7139bbd93bc8, /model.57/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,80,80]) -> /model.58/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) Layer(CaskJitConv): model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu), Tactic: 0xbb88763c3b0e94d4, /model.58/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) -> /model.59/Concat_output_0 (Half[1,128:32,40,40]) Layer(CaskConvolution): model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu), Tactic: 0x1ba323eb9858b2a9, /model.58/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) -> /model.77/m.0/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,80,80]) Layer(Reformat): /model.60/conv/_input_quantizer/QuantizeLinear, Tactic: 0x00000000000003ea, /model.59/Concat_output_0 (Half[1,256:32,40,40]) -> /model.60/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,40,40]) Layer(Reformat): /model.61/conv/_input_quantizer/QuantizeLinear, Tactic: 0x00000000000003ea, /model.59/Concat_output_0 (Half[1,256:32,40,40]) -> /model.61/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,40,40]) Layer(CaskConvolution): model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv, Tactic: 0x733ba2a91a48d431, /model.77/m.0/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,80,80]) -> /model.77/m.0/Conv_output_0 (Float[1,255,80,80]) Layer(CaskConvolution): model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu), Tactic: 0x0779fa4ac8f9f2ee, /model.60/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,40,40]) -> /model.65/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) Layer(CaskConvolution): model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu), Tactic: 0x0779fa4ac8f9f2ee, /model.61/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,40,40]) -> /model.62/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) Layer(PointWiseV2): PWN(/model.77/Sigmoid), Tactic: 0x0000000000000009, /model.77/m.0/Conv_output_0 (Float[1,255,80,80]) -> /model.77/Transpose_output_0 (Half[1,255,80,80]) Layer(Shuffle): /model.77/Reshape + /model.77/Transpose, Tactic: 0x0000000000000000, /model.77/Transpose_output_0 (Half[1,255,80,80]) -> /model.77/Sigmoid_output_0 (Half[1,3,80,80,85]) Layer(Slice): /model.77/Split, Tactic: 0x0000000000000000, /model.77/Sigmoid_output_0 (Half[1,3,80,80,85]) -> /model.77/Split_output_0 (Half[1,3,80,80,2]) Layer(Slice): /model.77/Split_110, Tactic: 0x0000000000000000, /model.77/Sigmoid_output_0 (Half[1,3,80,80,85]) -> /model.77/Split_output_1 (Half[1,3,80,80,2]) Layer(Slice): /model.77/Split_111, Tactic: 0x0000000000000000, /model.77/Sigmoid_output_0 (Half[1,3,80,80,85]) -> /model.77/Concat_output_0 (Half[1,3,80,80,81]) Layer(CaskConvolution): model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu), Tactic: 0x83caf00de690c0ec, /model.62/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) -> /model.63/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) Layer(PointWiseV2): PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add), Tactic: 0x0000000000000002, /model.77/Split_output_0 (Half[1,3,80,80,2]), (Unnamed Layer* 634) [Constant]_output (Half[1,1,80,80,2]) -> /model.77/Add_output_0 (Float[1,3,80,80,2]) Layer(PointWiseV2): PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1), Tactic: 0x000000000000001c, /model.77/Split_output_1 (Half[1,3,80,80,2]), (Unnamed Layer* 639) [Constant]_output (Half[1,3,1,1,2]) -> /model.77/Mul_1_output_0 (Half[1,3,80,80,2]) Layer(Reformat): /model.77/Add_output_0 copy, Tactic: 0x00000000000003e8, /model.77/Add_output_0 (Float[1,3,80,80,2]) -> /model.77/Concat_output_0 (Half[1,3,80,80,2]) Layer(Reformat): /model.77/Mul_1_output_0 copy, Tactic: 0x0000000000000000, /model.77/Mul_1_output_0 (Half[1,3,80,80,2]) -> /model.77/Concat_output_0 (Half[1,3,80,80,2]) Layer(NoOp): /model.77/Reshape_1, Tactic: 0x0000000000000000, /model.77/Concat_output_0 (Half[1,3,80,80,85]) -> /model.77/Reshape_1_copy_output (Half[1,19200,85]) Layer(Reformat): /model.77/Reshape_1_copy_output, Tactic: 0x0000000000000000, /model.77/Reshape_1_copy_output (Half[1,19200,85]) -> outputs (Float[1,19200,85]) Layer(CaskConvolution): model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu), Tactic: 0x83caf00de690c0ec, /model.63/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) -> /model.65/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) Layer(Reformat): /model.63/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.63/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) -> /model.65/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) Layer(Reformat): /model.62/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.62/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) -> /model.65/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) Layer(CaskConvolution): model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu), Tactic: 0x0779fa4ac8f9f2ee, /model.65/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,40,40]) -> /model.66/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) Layer(CaskJitConv): model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu), Tactic: 0xd3f592fae61c7986, /model.66/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) -> /model.67/Concat_output_0 (Half[1,256:32,20,20]) Layer(CaskConvolution): model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu), Tactic: 0xfbcd5a1da537e27f, /model.66/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) -> /model.77/m.1/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,40,40]) Layer(Reformat): /model.68/conv/_input_quantizer/QuantizeLinear, Tactic: 0x0000000000000000, /model.67/Concat_output_0 (Half[1,512:32,20,20]) -> /model.68/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,512:32,20,20]) Layer(Reformat): /model.69/conv/_input_quantizer/QuantizeLinear, Tactic: 0x0000000000000000, /model.67/Concat_output_0 (Half[1,512:32,20,20]) -> /model.69/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,512:32,20,20]) Layer(CaskConvolution): model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv, Tactic: 0x733ba2a91a48d431, /model.77/m.1/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,40,40]) -> /model.77/m.1/Conv_output_0 (Float[1,255,40,40]) Layer(CaskConvolution): model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu), Tactic: 0xeb1602207b0c3d49, /model.68/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,512:32,20,20]) -> /model.73/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,20,20]) Layer(CaskConvolution): model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu), Tactic: 0xeb1602207b0c3d49, /model.69/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,512:32,20,20]) -> /model.70/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,20,20]) Layer(PointWiseV2): PWN(/model.77/Sigmoid_1), Tactic: 0x0000000000000005, /model.77/m.1/Conv_output_0 (Float[1,255,40,40]) -> /model.77/Transpose_1_output_0 (Half[1,255,40,40]) Layer(Shuffle): /model.77/Reshape_2 + /model.77/Transpose_1, Tactic: 0x0000000000000000, /model.77/Transpose_1_output_0 (Half[1,255,40,40]) -> /model.77/Sigmoid_1_output_0 (Half[1,3,40,40,85]) Layer(Slice): /model.77/Split_1, Tactic: 0x0000000000000000, /model.77/Sigmoid_1_output_0 (Half[1,3,40,40,85]) -> /model.77/Split_1_output_0 (Half[1,3,40,40,2]) Layer(Slice): /model.77/Split_1_116, Tactic: 0x0000000000000000, /model.77/Sigmoid_1_output_0 (Half[1,3,40,40,85]) -> /model.77/Split_1_output_1 (Half[1,3,40,40,2]) Layer(Slice): /model.77/Split_1_117, Tactic: 0x0000000000000000, /model.77/Sigmoid_1_output_0 (Half[1,3,40,40,85]) -> /model.77/Concat_1_output_0 (Half[1,3,40,40,81]) Layer(CaskConvolution): model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu), Tactic: 0x7ddd3b3f55023bab, /model.70/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,20,20]) -> /model.71/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,20,20]) Layer(PointWiseV2): PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1), Tactic: 0x000000000000001c, /model.77/Split_1_output_0 (Half[1,3,40,40,2]), (Unnamed Layer* 662) [Constant]_output (Half[1,1,40,40,2]) -> /model.77/Add_1_output_0 (Half[1,3,40,40,2]) Layer(PointWiseV2): PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3), Tactic: 0x000000000000001c, /model.77/Split_1_output_1 (Half[1,3,40,40,2]), (Unnamed Layer* 667) [Constant]_output (Half[1,3,1,1,2]) -> /model.77/Mul_3_output_0 (Float[1,3,40,40,2]) Layer(Reformat): /model.77/Add_1_output_0 copy, Tactic: 0x00000000000003e8, /model.77/Add_1_output_0 (Half[1,3,40,40,2]) -> /model.77/Concat_1_output_0 (Half[1,3,40,40,2]) Layer(Reformat): /model.77/Mul_3_output_0 copy, Tactic: 0x00000000000003e8, /model.77/Mul_3_output_0 (Float[1,3,40,40,2]) -> /model.77/Concat_1_output_0 (Half[1,3,40,40,2]) Layer(NoOp): /model.77/Reshape_3, Tactic: 0x0000000000000000, /model.77/Concat_1_output_0 (Half[1,3,40,40,85]) -> /model.77/Reshape_3_copy_output (Half[1,4800,85]) Layer(Reformat): /model.77/Reshape_3_copy_output, Tactic: 0x00000000000003e8, /model.77/Reshape_3_copy_output (Half[1,4800,85]) -> outputs (Float[1,4800,85]) Layer(CaskConvolution): model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu), Tactic: 0x83caf00de690c0ec, /model.71/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,20,20]) -> /model.73/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,20,20]) Layer(Reformat): /model.71/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.71/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,20,20]) -> /model.73/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,20,20]) Layer(Reformat): /model.70/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.70/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,20,20]) -> /model.73/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,20,20]) Layer(CaskConvolution): model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu), Tactic: 0x4862d9a1cd4ec818, /model.73/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,512:32,20,20]) -> /model.76/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(CaskConvolution): model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu), Tactic: 0x5e921a04a7b0e583, /model.76/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) -> /model.77/m.2/_input_quantizer/QuantizeLinear_output_0 (Int8[1,512:32,20,20]) Layer(CaskConvolution): model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv, Tactic: 0x5e4f6d7c83746fd6, /model.77/m.2/_input_quantizer/QuantizeLinear_output_0 (Int8[1,512:32,20,20]) -> /model.77/m.2/Conv_output_0 (Float[1,255,20,20]) Layer(PointWiseV2): PWN(/model.77/Sigmoid_2), Tactic: 0x0000000000000002, /model.77/m.2/Conv_output_0 (Float[1,255,20,20]) -> /model.77/Transpose_2_output_0 (Half[1,255,20,20]) Layer(Shuffle): /model.77/Reshape_4 + /model.77/Transpose_2, Tactic: 0x0000000000000000, /model.77/Transpose_2_output_0 (Half[1,255,20,20]) -> /model.77/Sigmoid_2_output_0 (Half[1,3,20,20,85]) Layer(Slice): /model.77/Split_2, Tactic: 0x0000000000000000, /model.77/Sigmoid_2_output_0 (Half[1,3,20,20,85]) -> /model.77/Split_2_output_0 (Half[1,3,20,20,2]) Layer(Slice): /model.77/Split_2_122, Tactic: 0x0000000000000000, /model.77/Sigmoid_2_output_0 (Half[1,3,20,20,85]) -> /model.77/Split_2_output_1 (Half[1,3,20,20,2]) Layer(Slice): /model.77/Split_2_123, Tactic: 0x0000000000000000, /model.77/Sigmoid_2_output_0 (Half[1,3,20,20,85]) -> /model.77/Concat_2_output_0 (Half[1,3,20,20,81]) Layer(Constant): /model.77/Constant_14_output_0, Tactic: 0x0000000000000000, -> (Unnamed Layer* 690) [Constant]_output (Half[1,1,20,20,2]) Layer(PointWiseV2): PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2), Tactic: 0x0000000000000000, /model.77/Split_2_output_0 (Half[1,3,20,20,2]), (Unnamed Layer* 690) [Constant]_output (Half[1,1,20,20,2]) -> /model.77/Add_2_output_0 (Float[1,3,20,20,2]) Layer(Constant): /model.77/Constant_16_output_0, Tactic: 0x0000000000000000, -> (Unnamed Layer* 695) [Constant]_output (Half[1,3,1,1,2]) Layer(PointWiseV2): PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5), Tactic: 0x000000000000001c, /model.77/Split_2_output_1 (Half[1,3,20,20,2]), (Unnamed Layer* 695) [Constant]_output (Half[1,3,1,1,2]) -> /model.77/Mul_5_output_0 (Half[1,3,20,20,2]) Layer(Reformat): /model.77/Add_2_output_0 copy, Tactic: 0x0000000000000000, /model.77/Add_2_output_0 (Float[1,3,20,20,2]) -> /model.77/Concat_2_output_0 (Half[1,3,20,20,2]) Layer(Reformat): /model.77/Mul_5_output_0 copy, Tactic: 0x00000000000003e8, /model.77/Mul_5_output_0 (Half[1,3,20,20,2]) -> /model.77/Concat_2_output_0 (Half[1,3,20,20,2]) Layer(NoOp): /model.77/Reshape_5, Tactic: 0x0000000000000000, /model.77/Concat_2_output_0 (Half[1,3,20,20,85]) -> /model.77/Reshape_5_copy_output (Half[1,1200,85]) Layer(Reformat): /model.77/Reshape_5_copy_output, Tactic: 0x00000000000003e8, /model.77/Reshape_5_copy_output (Half[1,1200,85]) -> outputs (Float[1,1200,85]) [04/18/2023-13:44:41] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in building engine: CPU +6, GPU +7, now: CPU 6, GPU 7 (MiB) [04/18/2023-13:44:41] [I] Engine built in 324.81 sec. [04/18/2023-13:44:42] [I] [TRT] Loaded engine size: 8 MiB [04/18/2023-13:44:42] [V] [TRT] Deserialization required 19000 microseconds. [04/18/2023-13:44:42] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +6, now: CPU 0, GPU 6 (MiB) [04/18/2023-13:44:42] [I] Engine deserialized in 0.0192553 sec. [04/18/2023-13:44:42] [V] [TRT] Total per-runner device persistent memory is 614912 [04/18/2023-13:44:42] [V] [TRT] Total per-runner host persistent memory is 191296 [04/18/2023-13:44:42] [V] [TRT] Allocated activation device memory of size 21862400 [04/18/2023-13:44:42] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +22, now: CPU 0, GPU 28 (MiB) [04/18/2023-13:44:42] [V] [TRT] CUDA lazy loading is enabled. [04/18/2023-13:44:42] [I] Setting persistentCacheLimit to 0 bytes. [04/18/2023-13:44:42] [V] Using enqueueV3. [04/18/2023-13:44:42] [I] Using random values for input images [04/18/2023-13:44:42] [I] Created input binding for images with dimensions 1x3x640x640 [04/18/2023-13:44:42] [I] Using random values for output outputs [04/18/2023-13:44:42] [I] Created output binding for outputs with dimensions 1x25200x85 [04/18/2023-13:44:42] [I] Starting inference [04/18/2023-13:44:45] [I] Warmup completed 196 queries over 200 ms [04/18/2023-13:44:45] [I] Timing trace has 2777 queries over 3.00222 s [04/18/2023-13:44:45] [I] [04/18/2023-13:44:45] [I] === Trace details === [04/18/2023-13:44:45] [I] Trace averages of 10 runs: [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.670207 ms - Host latency: 1.87248 ms (enqueue 0.0160263 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.670103 ms - Host latency: 1.87424 ms (enqueue 0.0159851 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669902 ms - Host latency: 1.87074 ms (enqueue 0.0159592 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.670062 ms - Host latency: 1.86605 ms (enqueue 0.0159561 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669798 ms - Host latency: 1.8557 ms (enqueue 0.0160004 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668532 ms - Host latency: 1.86254 ms (enqueue 0.0159042 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669287 ms - Host latency: 1.8449 ms (enqueue 0.0159576 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669186 ms - Host latency: 1.86967 ms (enqueue 0.0159271 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668057 ms - Host latency: 1.85407 ms (enqueue 0.0160126 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.667542 ms - Host latency: 1.86197 ms (enqueue 0.0159546 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.667853 ms - Host latency: 1.85556 ms (enqueue 0.0159393 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668533 ms - Host latency: 1.86429 ms (enqueue 0.0159027 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.667548 ms - Host latency: 1.84648 ms (enqueue 0.0159912 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668878 ms - Host latency: 1.86611 ms (enqueue 0.0160553 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668668 ms - Host latency: 1.85077 ms (enqueue 0.0159454 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669183 ms - Host latency: 1.86082 ms (enqueue 0.0159668 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668262 ms - Host latency: 1.84799 ms (enqueue 0.0159271 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.667444 ms - Host latency: 1.86471 ms (enqueue 0.0158936 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668057 ms - Host latency: 1.85126 ms (enqueue 0.0159149 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668781 ms - Host latency: 1.85821 ms (enqueue 0.0159485 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668875 ms - Host latency: 1.84685 ms (enqueue 0.0160522 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.667853 ms - Host latency: 1.85649 ms (enqueue 0.0159271 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669177 ms - Host latency: 1.85597 ms (enqueue 0.01604 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.667755 ms - Host latency: 1.86155 ms (enqueue 0.0159058 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668057 ms - Host latency: 1.84765 ms (enqueue 0.0158752 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.66785 ms - Host latency: 1.85212 ms (enqueue 0.0161316 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668976 ms - Host latency: 1.84247 ms (enqueue 0.015921 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668329 ms - Host latency: 1.87327 ms (enqueue 0.0159119 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.667233 ms - Host latency: 1.85775 ms (enqueue 0.0159912 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.670068 ms - Host latency: 1.87208 ms (enqueue 0.0158722 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.667542 ms - Host latency: 1.8492 ms (enqueue 0.0159576 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.66806 ms - Host latency: 1.86071 ms (enqueue 0.0159821 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.667749 ms - Host latency: 1.84832 ms (enqueue 0.0160095 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668634 ms - Host latency: 1.86534 ms (enqueue 0.0158997 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669177 ms - Host latency: 1.85563 ms (enqueue 0.0160461 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668274 ms - Host latency: 1.85968 ms (enqueue 0.0159241 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.667133 ms - Host latency: 1.8515 ms (enqueue 0.0158569 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668359 ms - Host latency: 1.87149 ms (enqueue 0.0158997 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669043 ms - Host latency: 1.85494 ms (enqueue 0.0159424 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.671552 ms - Host latency: 1.86561 ms (enqueue 0.0160583 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669043 ms - Host latency: 1.86205 ms (enqueue 0.0161011 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.667767 ms - Host latency: 1.85656 ms (enqueue 0.0158875 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668671 ms - Host latency: 1.86397 ms (enqueue 0.01604 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.670923 ms - Host latency: 1.85136 ms (enqueue 0.015979 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.66897 ms - Host latency: 1.86648 ms (enqueue 0.0159302 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669293 ms - Host latency: 1.85641 ms (enqueue 0.0160095 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668658 ms - Host latency: 1.84547 ms (enqueue 0.0158081 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669598 ms - Host latency: 1.87202 ms (enqueue 0.015918 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668573 ms - Host latency: 1.85511 ms (enqueue 0.0157104 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668982 ms - Host latency: 1.85807 ms (enqueue 0.0156311 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.667542 ms - Host latency: 1.85558 ms (enqueue 0.0156311 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.66806 ms - Host latency: 1.86242 ms (enqueue 0.0157776 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669141 ms - Host latency: 1.85167 ms (enqueue 0.0157593 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669189 ms - Host latency: 1.85733 ms (enqueue 0.0156311 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.667859 ms - Host latency: 1.84866 ms (enqueue 0.0155945 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.667535 ms - Host latency: 1.85532 ms (enqueue 0.0157104 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.667651 ms - Host latency: 1.83527 ms (enqueue 0.0156006 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.670508 ms - Host latency: 1.87275 ms (enqueue 0.0156555 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668567 ms - Host latency: 1.85496 ms (enqueue 0.0157776 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668689 ms - Host latency: 1.86113 ms (enqueue 0.0162598 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668365 ms - Host latency: 1.84839 ms (enqueue 0.0163147 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.66795 ms - Host latency: 1.85822 ms (enqueue 0.0191956 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.667944 ms - Host latency: 1.86351 ms (enqueue 0.0235535 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668671 ms - Host latency: 1.86862 ms (enqueue 0.0296875 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668011 ms - Host latency: 1.85287 ms (enqueue 0.0408569 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668872 ms - Host latency: 1.91329 ms (enqueue 0.065387 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.670007 ms - Host latency: 1.94004 ms (enqueue 0.0850281 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668262 ms - Host latency: 1.92651 ms (enqueue 0.0802673 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668878 ms - Host latency: 1.93199 ms (enqueue 0.0803223 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669592 ms - Host latency: 1.93301 ms (enqueue 0.0802307 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.670313 ms - Host latency: 1.93462 ms (enqueue 0.080365 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668463 ms - Host latency: 1.93455 ms (enqueue 0.0807373 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669086 ms - Host latency: 1.938 ms (enqueue 0.0801453 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668585 ms - Host latency: 1.93493 ms (enqueue 0.0823669 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.670099 ms - Host latency: 1.93335 ms (enqueue 0.0804199 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669501 ms - Host latency: 1.94195 ms (enqueue 0.0799133 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.670093 ms - Host latency: 1.93735 ms (enqueue 0.07995 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669501 ms - Host latency: 1.92239 ms (enqueue 0.080249 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.670422 ms - Host latency: 1.94354 ms (enqueue 0.0804626 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669543 ms - Host latency: 1.93073 ms (enqueue 0.0886169 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.671405 ms - Host latency: 1.94181 ms (enqueue 0.0875244 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.670435 ms - Host latency: 1.92373 ms (enqueue 0.080249 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.670984 ms - Host latency: 1.93505 ms (enqueue 0.0871704 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668787 ms - Host latency: 1.93428 ms (enqueue 0.0803711 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.670911 ms - Host latency: 1.94231 ms (enqueue 0.0810425 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668787 ms - Host latency: 1.92825 ms (enqueue 0.0802124 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.67052 ms - Host latency: 1.92341 ms (enqueue 0.080127 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.66969 ms - Host latency: 1.92739 ms (enqueue 0.0800537 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.67019 ms - Host latency: 1.92251 ms (enqueue 0.0798218 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.670178 ms - Host latency: 1.92754 ms (enqueue 0.0806519 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669287 ms - Host latency: 1.92953 ms (enqueue 0.0802612 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.670313 ms - Host latency: 1.93848 ms (enqueue 0.079602 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.672376 ms - Host latency: 1.92863 ms (enqueue 0.0795288 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669861 ms - Host latency: 1.93942 ms (enqueue 0.0794922 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.66908 ms - Host latency: 1.92645 ms (enqueue 0.0789063 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669983 ms - Host latency: 1.92788 ms (enqueue 0.0818359 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.671387 ms - Host latency: 1.92708 ms (enqueue 0.0792725 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.67052 ms - Host latency: 1.93783 ms (enqueue 0.0793823 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669006 ms - Host latency: 1.92592 ms (enqueue 0.0801147 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.671118 ms - Host latency: 1.93612 ms (enqueue 0.0794434 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.66886 ms - Host latency: 1.93678 ms (enqueue 0.0797852 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.671106 ms - Host latency: 1.94923 ms (enqueue 0.0796387 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668787 ms - Host latency: 1.94114 ms (enqueue 0.079834 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.670593 ms - Host latency: 1.9433 ms (enqueue 0.0801147 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.66803 ms - Host latency: 1.93837 ms (enqueue 0.0797241 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669495 ms - Host latency: 1.94373 ms (enqueue 0.0797607 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668799 ms - Host latency: 1.93937 ms (enqueue 0.0796997 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.670691 ms - Host latency: 1.94236 ms (enqueue 0.0821167 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668872 ms - Host latency: 1.93898 ms (enqueue 0.0803101 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668262 ms - Host latency: 1.9374 ms (enqueue 0.0796753 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.66908 ms - Host latency: 1.94521 ms (enqueue 0.0842896 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668701 ms - Host latency: 1.94463 ms (enqueue 0.0830811 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.67019 ms - Host latency: 1.94374 ms (enqueue 0.0799439 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.670435 ms - Host latency: 1.94055 ms (enqueue 0.079895 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669592 ms - Host latency: 1.93832 ms (enqueue 0.0796387 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668066 ms - Host latency: 1.93684 ms (enqueue 0.0795044 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668909 ms - Host latency: 1.94149 ms (enqueue 0.0796387 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.6698 ms - Host latency: 1.93958 ms (enqueue 0.0802612 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668982 ms - Host latency: 1.93833 ms (enqueue 0.0797241 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668958 ms - Host latency: 1.94028 ms (enqueue 0.0798096 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669116 ms - Host latency: 1.94756 ms (enqueue 0.0821655 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.670923 ms - Host latency: 1.94338 ms (enqueue 0.0802002 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668445 ms - Host latency: 1.94142 ms (enqueue 0.0797729 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.66958 ms - Host latency: 1.93702 ms (enqueue 0.0797974 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.67074 ms - Host latency: 1.9376 ms (enqueue 0.081604 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669263 ms - Host latency: 1.93988 ms (enqueue 0.0797119 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.670227 ms - Host latency: 1.94097 ms (enqueue 0.0799072 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.670508 ms - Host latency: 1.94667 ms (enqueue 0.0797485 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668176 ms - Host latency: 1.94113 ms (enqueue 0.0799561 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.671143 ms - Host latency: 1.94359 ms (enqueue 0.0825806 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668286 ms - Host latency: 1.93884 ms (enqueue 0.0797729 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669092 ms - Host latency: 1.94005 ms (enqueue 0.0794922 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668677 ms - Host latency: 1.94031 ms (enqueue 0.0831787 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668591 ms - Host latency: 1.93961 ms (enqueue 0.0796753 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.667749 ms - Host latency: 1.93599 ms (enqueue 0.0796997 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668347 ms - Host latency: 1.94012 ms (enqueue 0.0802124 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669006 ms - Host latency: 1.94197 ms (enqueue 0.079541 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.667969 ms - Host latency: 1.94099 ms (enqueue 0.0798096 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673267 ms - Host latency: 1.94501 ms (enqueue 0.0797485 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668555 ms - Host latency: 1.94315 ms (enqueue 0.0870239 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668762 ms - Host latency: 1.93682 ms (enqueue 0.0796387 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.67074 ms - Host latency: 1.93994 ms (enqueue 0.0820557 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669507 ms - Host latency: 1.94233 ms (enqueue 0.079834 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668872 ms - Host latency: 1.93865 ms (enqueue 0.0796875 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.670203 ms - Host latency: 1.94001 ms (enqueue 0.0799805 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669495 ms - Host latency: 1.94054 ms (enqueue 0.0823853 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668896 ms - Host latency: 1.93555 ms (enqueue 0.0796875 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669702 ms - Host latency: 1.9489 ms (enqueue 0.0799316 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669189 ms - Host latency: 1.94038 ms (enqueue 0.0798462 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669177 ms - Host latency: 1.94352 ms (enqueue 0.0799194 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668457 ms - Host latency: 1.9432 ms (enqueue 0.0885864 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669421 ms - Host latency: 1.94199 ms (enqueue 0.0820679 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.669775 ms - Host latency: 1.93354 ms (enqueue 0.0796753 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.668958 ms - Host latency: 1.938 ms (enqueue 0.0819092 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.670898 ms - Host latency: 1.95262 ms (enqueue 0.0803467 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.672376 ms - Host latency: 1.94741 ms (enqueue 0.0794922 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.671448 ms - Host latency: 1.94479 ms (enqueue 0.0792969 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.672791 ms - Host latency: 1.9465 ms (enqueue 0.0820435 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.67301 ms - Host latency: 1.9433 ms (enqueue 0.0799072 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.672864 ms - Host latency: 1.94185 ms (enqueue 0.0796387 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.672949 ms - Host latency: 1.94416 ms (enqueue 0.0796631 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.672241 ms - Host latency: 1.94252 ms (enqueue 0.0796265 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.675415 ms - Host latency: 1.9483 ms (enqueue 0.0797974 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.674683 ms - Host latency: 1.94747 ms (enqueue 0.0829956 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673376 ms - Host latency: 1.94771 ms (enqueue 0.0845459 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.6745 ms - Host latency: 1.94409 ms (enqueue 0.0795776 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673413 ms - Host latency: 1.94569 ms (enqueue 0.0797485 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.672681 ms - Host latency: 1.94342 ms (enqueue 0.0799194 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.672363 ms - Host latency: 1.93718 ms (enqueue 0.0792114 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673279 ms - Host latency: 1.93909 ms (enqueue 0.080249 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.672986 ms - Host latency: 1.93743 ms (enqueue 0.0823364 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.674609 ms - Host latency: 1.93655 ms (enqueue 0.0790771 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.675 ms - Host latency: 1.93916 ms (enqueue 0.0797729 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.675439 ms - Host latency: 1.95027 ms (enqueue 0.079248 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.676562 ms - Host latency: 1.94058 ms (enqueue 0.0790039 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.675195 ms - Host latency: 1.94033 ms (enqueue 0.0792236 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.675952 ms - Host latency: 1.94458 ms (enqueue 0.0823242 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.67583 ms - Host latency: 1.93926 ms (enqueue 0.0790527 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.675708 ms - Host latency: 1.93367 ms (enqueue 0.0838867 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.674463 ms - Host latency: 1.93513 ms (enqueue 0.086084 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673291 ms - Host latency: 1.9333 ms (enqueue 0.078125 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.67522 ms - Host latency: 1.94167 ms (enqueue 0.079541 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.674609 ms - Host latency: 1.94082 ms (enqueue 0.0817871 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.675586 ms - Host latency: 1.94346 ms (enqueue 0.0789063 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.674292 ms - Host latency: 1.94561 ms (enqueue 0.0825195 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.675122 ms - Host latency: 1.94326 ms (enqueue 0.0791992 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.674658 ms - Host latency: 1.94534 ms (enqueue 0.0791016 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.677808 ms - Host latency: 1.94233 ms (enqueue 0.0789795 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.67334 ms - Host latency: 1.93911 ms (enqueue 0.0792969 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.674902 ms - Host latency: 1.93494 ms (enqueue 0.0854248 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.675195 ms - Host latency: 1.93867 ms (enqueue 0.0870117 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.674951 ms - Host latency: 1.94619 ms (enqueue 0.0789307 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673682 ms - Host latency: 1.93914 ms (enqueue 0.0791504 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.674146 ms - Host latency: 1.93433 ms (enqueue 0.0789551 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.674072 ms - Host latency: 1.93669 ms (enqueue 0.0791016 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673804 ms - Host latency: 1.93845 ms (enqueue 0.0848389 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.678052 ms - Host latency: 1.94529 ms (enqueue 0.0849121 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.675952 ms - Host latency: 1.93928 ms (enqueue 0.0790039 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.675684 ms - Host latency: 1.9373 ms (enqueue 0.0807129 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673926 ms - Host latency: 1.94822 ms (enqueue 0.0790527 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.672778 ms - Host latency: 1.93948 ms (enqueue 0.0794189 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673779 ms - Host latency: 1.95588 ms (enqueue 0.0791504 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.674219 ms - Host latency: 1.93403 ms (enqueue 0.0790283 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.674048 ms - Host latency: 1.94416 ms (enqueue 0.0829346 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.674829 ms - Host latency: 1.93533 ms (enqueue 0.0843506 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673267 ms - Host latency: 1.93643 ms (enqueue 0.083374 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.677393 ms - Host latency: 1.93625 ms (enqueue 0.0809326 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.675024 ms - Host latency: 1.93879 ms (enqueue 0.0804932 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673657 ms - Host latency: 1.93977 ms (enqueue 0.0835205 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.674023 ms - Host latency: 1.95425 ms (enqueue 0.0785889 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.675659 ms - Host latency: 1.93909 ms (enqueue 0.0855469 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.675855 ms - Host latency: 1.94541 ms (enqueue 0.0824463 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673608 ms - Host latency: 1.93691 ms (enqueue 0.0847168 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.675659 ms - Host latency: 1.94207 ms (enqueue 0.0852539 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.675928 ms - Host latency: 1.93508 ms (enqueue 0.0794922 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.677246 ms - Host latency: 1.93525 ms (enqueue 0.0794434 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.672485 ms - Host latency: 1.93318 ms (enqueue 0.0865234 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.676685 ms - Host latency: 1.9446 ms (enqueue 0.0821289 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.67478 ms - Host latency: 1.94944 ms (enqueue 0.0857422 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673462 ms - Host latency: 1.93943 ms (enqueue 0.0805664 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673096 ms - Host latency: 1.93103 ms (enqueue 0.0791504 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.676465 ms - Host latency: 1.93467 ms (enqueue 0.0789307 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673315 ms - Host latency: 1.94099 ms (enqueue 0.0822998 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673389 ms - Host latency: 1.93857 ms (enqueue 0.0792725 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673511 ms - Host latency: 1.93821 ms (enqueue 0.0896484 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.674561 ms - Host latency: 1.93687 ms (enqueue 0.0808105 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.675415 ms - Host latency: 1.94099 ms (enqueue 0.0789551 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.67627 ms - Host latency: 1.94075 ms (enqueue 0.0798828 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.675635 ms - Host latency: 1.95684 ms (enqueue 0.0915527 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.674292 ms - Host latency: 1.9457 ms (enqueue 0.0833008 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.672241 ms - Host latency: 1.94158 ms (enqueue 0.0796387 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.672022 ms - Host latency: 1.94941 ms (enqueue 0.0853271 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673999 ms - Host latency: 1.94546 ms (enqueue 0.090332 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.675317 ms - Host latency: 1.94868 ms (enqueue 0.0798096 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.672192 ms - Host latency: 1.94121 ms (enqueue 0.0821533 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.671753 ms - Host latency: 1.94416 ms (enqueue 0.0865723 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.672339 ms - Host latency: 1.95142 ms (enqueue 0.0976807 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.672437 ms - Host latency: 1.94751 ms (enqueue 0.0891846 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.67207 ms - Host latency: 1.89072 ms (enqueue 0.0796143 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.671948 ms - Host latency: 1.81143 ms (enqueue 0.0397949 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.671533 ms - Host latency: 1.80703 ms (enqueue 0.0412354 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673145 ms - Host latency: 1.86331 ms (enqueue 0.0341064 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.672168 ms - Host latency: 1.85806 ms (enqueue 0.0340576 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.671924 ms - Host latency: 1.84888 ms (enqueue 0.0451172 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.671387 ms - Host latency: 1.9178 ms (enqueue 0.0722412 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.672485 ms - Host latency: 1.94751 ms (enqueue 0.0884766 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.6729 ms - Host latency: 1.95112 ms (enqueue 0.0883057 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.674634 ms - Host latency: 1.93591 ms (enqueue 0.0822022 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.674927 ms - Host latency: 1.92849 ms (enqueue 0.0822754 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.672998 ms - Host latency: 1.93562 ms (enqueue 0.0822022 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.672534 ms - Host latency: 1.94834 ms (enqueue 0.0898438 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.671558 ms - Host latency: 1.92432 ms (enqueue 0.0822266 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.670239 ms - Host latency: 1.8145 ms (enqueue 0.0601318 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.671558 ms - Host latency: 1.85166 ms (enqueue 0.0434814 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.67207 ms - Host latency: 1.85955 ms (enqueue 0.0447998 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673535 ms - Host latency: 1.86445 ms (enqueue 0.0487549 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.671533 ms - Host latency: 1.93396 ms (enqueue 0.0884277 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.672949 ms - Host latency: 1.92998 ms (enqueue 0.098877 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673389 ms - Host latency: 1.93955 ms (enqueue 0.0792969 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.67439 ms - Host latency: 1.92974 ms (enqueue 0.0791016 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.671631 ms - Host latency: 1.94092 ms (enqueue 0.0794434 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.674023 ms - Host latency: 1.93977 ms (enqueue 0.0794434 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.67522 ms - Host latency: 1.93115 ms (enqueue 0.0791992 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.672046 ms - Host latency: 1.93516 ms (enqueue 0.0839844 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.674146 ms - Host latency: 1.94993 ms (enqueue 0.0797607 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673022 ms - Host latency: 1.93914 ms (enqueue 0.079248 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673608 ms - Host latency: 1.93137 ms (enqueue 0.0792725 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673486 ms - Host latency: 1.9293 ms (enqueue 0.079126 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.672778 ms - Host latency: 1.93342 ms (enqueue 0.079126 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.675 ms - Host latency: 1.93811 ms (enqueue 0.0794678 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.671191 ms - Host latency: 1.93027 ms (enqueue 0.0817139 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.674097 ms - Host latency: 1.94065 ms (enqueue 0.0791748 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.672485 ms - Host latency: 1.93286 ms (enqueue 0.079248 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673462 ms - Host latency: 1.95305 ms (enqueue 0.0799072 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.671924 ms - Host latency: 1.94648 ms (enqueue 0.0792236 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.673096 ms - Host latency: 1.85593 ms (enqueue 0.0224365 ms) [04/18/2023-13:44:45] [I] Average on 10 runs - GPU latency: 0.672241 ms - Host latency: 1.86497 ms (enqueue 0.0185059 ms) [04/18/2023-13:44:45] [I] [04/18/2023-13:44:45] [I] === Performance summary === [04/18/2023-13:44:45] [I] Throughput: 924.984 qps [04/18/2023-13:44:45] [I] Latency: min = 1.77173 ms, max = 2.03271 ms, mean = 1.91611 ms, median = 1.91211 ms, percentile(90%) = 1.9762 ms, percentile(95%) = 1.98669 ms, percentile(99%) = 2.00488 ms [04/18/2023-13:44:45] [I] Enqueue Time: min = 0.0152588 ms, max = 0.182129 ms, mean = 0.0643361 ms, median = 0.0793457 ms, percentile(90%) = 0.0805664 ms, percentile(95%) = 0.0839844 ms, percentile(99%) = 0.121216 ms [04/18/2023-13:44:45] [I] H2D Latency: min = 0.38736 ms, max = 0.572998 ms, mean = 0.464608 ms, median = 0.445343 ms, percentile(90%) = 0.532959 ms, percentile(95%) = 0.539551 ms, percentile(99%) = 0.550293 ms [04/18/2023-13:44:45] [I] GPU Compute Time: min = 0.663544 ms, max = 0.692139 ms, mean = 0.671243 ms, median = 0.670654 ms, percentile(90%) = 0.677856 ms, percentile(95%) = 0.681152 ms, percentile(99%) = 0.686035 ms [04/18/2023-13:44:45] [I] D2H Latency: min = 0.654053 ms, max = 0.850586 ms, mean = 0.780262 ms, median = 0.770752 ms, percentile(90%) = 0.819824 ms, percentile(95%) = 0.822632 ms, percentile(99%) = 0.834961 ms [04/18/2023-13:44:45] [I] Total Host Walltime: 3.00222 s [04/18/2023-13:44:45] [I] Total GPU Compute Time: 1.86404 s [04/18/2023-13:44:45] [I] Explanations of the performance metrics are printed in the verbose logs. [04/18/2023-13:44:45] [V] [04/18/2023-13:44:45] [V] === Explanations of the performance metrics === [04/18/2023-13:44:45] [V] Total Host Walltime: the host walltime from when the first query (after warmups) is enqueued to when the last query is completed. [04/18/2023-13:44:45] [V] GPU Compute Time: the GPU latency to execute the kernels for a query. [04/18/2023-13:44:45] [V] Total GPU Compute Time: the summation of the GPU Compute Time of all the queries. If this is significantly shorter than Total Host Walltime, the GPU may be under-utilized because of host-side overheads or data transfers. [04/18/2023-13:44:45] [V] Throughput: the observed throughput computed by dividing the number of queries by the Total Host Walltime. If this is significantly lower than the reciprocal of GPU Compute Time, the GPU may be under-utilized because of host-side overheads or data transfers. [04/18/2023-13:44:45] [V] Enqueue Time: the host latency to enqueue a query. If this is longer than GPU Compute Time, the GPU may be under-utilized. [04/18/2023-13:44:45] [V] H2D Latency: the latency for host-to-device data transfers for input tensors of a single query. [04/18/2023-13:44:45] [V] D2H Latency: the latency for device-to-host data transfers for output tensors of a single query. [04/18/2023-13:44:45] [V] Latency: the summation of H2D Latency, GPU Compute Time, and D2H Latency. This is the latency to infer a single query. [04/18/2023-13:44:45] [I] &&&& PASSED TensorRT.trtexec [TensorRT v8503] # trtexec --onnx=ptq-sparse-640.onnx --saveEngine=ptq-tiny-yolov7-sparse-640.trt --int8 --fp16 --sparsity=enable --useCudaGraph --verbose